-- Logs begin at Sat 2022-09-03 20:34:01 UTC, end at Sat 2022-09-03 21:45:34 UTC. -- Sep 03 21:12:24.342059 dv-osbrick-855740-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Sep 03 21:12:24.353645 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 03 21:12:24.355718 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 3 21:12:24 2022] *** Sep 03 21:12:24.355718 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 21:12:24.355718 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 21:12:24.355718 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: nodename: dv-osbrick-855740-1-ceph Sep 03 21:12:24.355718 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: machine: x86_64 Sep 03 21:12:24.355718 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: clock source: unix Sep 03 21:12:24.355718 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: pcre jit disabled Sep 03 21:12:24.355718 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: detected number of CPU cores: 4 Sep 03 21:12:24.355718 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: current working directory: / Sep 03 21:12:24.355718 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: detected binary path: /usr/bin/uwsgi-core Sep 03 21:12:24.355718 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: your processes number limit is 47680 Sep 03 21:12:24.355718 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: your memory page size is 4096 bytes Sep 03 21:12:24.355718 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: detected max file descriptor number: 2048 Sep 03 21:12:24.355718 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: lock engine: pthread robust mutexes Sep 03 21:12:24.357309 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: thunder lock: enabled Sep 03 21:12:24.357309 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 03 21:12:24.357309 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 03 21:12:24.404468 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: Python main interpreter initialized at 0x557b292a69c0 Sep 03 21:12:24.404468 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: python threads support enabled Sep 03 21:12:24.404468 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: your server socket listen backlog is limited to 100 connections Sep 03 21:12:24.404468 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: your mercy for graceful operations on workers is 90 seconds Sep 03 21:12:24.404883 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 21:12:24.404948 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: *** Operational MODE: preforking *** Sep 03 21:12:24.405242 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: *** uWSGI is running in multiple interpreter mode *** Sep 03 21:12:24.405242 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: spawned uWSGI master process (pid: 88360) Sep 03 21:12:24.405519 dv-osbrick-855740-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Sep 03 21:12:24.410321 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: spawned uWSGI worker 1 (pid: 88384, cores: 1) Sep 03 21:12:24.410321 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: spawned uWSGI worker 2 (pid: 88385, cores: 1) Sep 03 21:12:24.410321 dv-osbrick-855740-1-ceph devstack@keystone.service[88360]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 21:12:29.263306 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 21:12:29.263306 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: from cryptography.utils import int_from_bytes Sep 03 21:12:29.264089 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 21:12:29.264089 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: from cryptography.utils import int_from_bytes Sep 03 21:12:29.291674 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 21:12:29.291674 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: from cryptography.utils import int_from_bytes Sep 03 21:12:29.292286 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 21:12:29.292286 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: from cryptography.utils import int_from_bytes Sep 03 21:12:29.315235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 21:12:29.315493 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 21:12:29.315741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] command line args: [] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 21:12:29.316095 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 21:12:29.316342 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ================================================================================ {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 21:12:29.316686 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] admin_token = **** {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.317013 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] config_dir = [] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.317273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.317515 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] config_source = [] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.317775 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] debug = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.318051 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.319492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.319492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.319492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.319817 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.320105 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] list_limit = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.320369 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] log_config_append = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.320858 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.321095 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] log_dir = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.321344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] log_file = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.321710 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.322083 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.322431 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.322782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.323048 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.323327 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.323665 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.324004 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.324336 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.324710 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.325046 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.325412 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.325755 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.326134 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.326509 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.327109 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.327385 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] publish_errors = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.328271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.328638 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.328903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.329255 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.329588 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.329916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] standard_threads = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.330244 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.330585 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.330848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.331118 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] use_journal = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.331387 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] use_json = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.331652 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] use_stderr = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.331913 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] use_syslog = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.332243 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.332643 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.332976 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.333338 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.333672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.334012 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.334349 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.334696 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.335021 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.335371 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.335712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.336062 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.336412 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.336785 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.337120 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.337469 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.337817 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.338143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.338492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.338837 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.339180 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.339509 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.339852 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.340214 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.340665 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.341012 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.341421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.341683 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 21:12:29.341830 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.341963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 21:12:29.342132 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] command line args: [] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 21:12:29.342291 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.342436 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 21:12:29.342564 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ================================================================================ {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 21:12:29.342700 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.342832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] admin_token = **** {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.342981 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] config_dir = [] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.343102 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.343218 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.345906 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] config_source = [] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.346090 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.346225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] debug = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.346421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.346569 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.346569 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.346919 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.347057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.347057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.347303 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.347439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.347439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] list_limit = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.347678 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.347819 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] log_config_append = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.347819 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.348172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.348304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] log_dir = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.348304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] log_file = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.348640 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.348797 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.348797 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.349043 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.349176 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.349176 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.349486 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.349630 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.349630 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.349965 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.350165 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.350165 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.350407 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.350559 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.350559 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.350804 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.350945 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.350945 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.351187 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.351330 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.351467 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.351598 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.351598 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.351828 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.351958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.352108 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.352245 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] publish_errors = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.352245 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.352480 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.352664 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.352664 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.352912 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.353042 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.353042 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.353277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.353419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] standard_threads = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.353419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.353653 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.353783 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.353783 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.354017 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.354256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] use_journal = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.354256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] use_json = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.354493 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.354620 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] use_stderr = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.354620 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] use_syslog = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.354620 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 21:12:29.354983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.355122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.355251 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.355382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.355382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.355607 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.355815 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.355815 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.356054 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.356191 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.356191 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.356443 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.356617 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.356617 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.356858 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.356996 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.356996 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.357233 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.357375 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.357375 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.357673 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.357804 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.357804 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.358039 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.358182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.358182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.358418 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.358548 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.358730 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.358992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.358992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.359254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.359440 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.359440 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.359755 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.359904 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.360036 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.360178 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.360319 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.360459 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.360459 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.368446 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.368657 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.368657 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.368893 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.368970 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.368970 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.369082 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.369142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.369209 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.369270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.369330 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.369387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.369445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.369503 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.369568 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.369628 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.369686 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.369744 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.369839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.369959 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.370038 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.370100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.370159 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.370216 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.370274 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.370332 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.370401 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.370467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.370526 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.370630 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.370630 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.370838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.370954 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.371042 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.371104 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.371169 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.371169 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.371275 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.371275 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.371388 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.371447 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.371550 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.371669 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.371741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.371857 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.371947 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.372008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.372065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.372130 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.372196 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.372263 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.372323 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.372380 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.372437 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.372495 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.372660 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.372726 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.372784 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.372841 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.372958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.373063 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.373137 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.373208 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.373278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.373278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.373404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.373471 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.373530 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.373593 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.373762 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.373879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.373996 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.374077 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.374077 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.374184 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.374250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.374310 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.374515 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.374960 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.375126 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.375193 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.375261 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] auth.external = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.375321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.375380 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.375444 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.375509 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.375612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.375729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.375853 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.375974 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] auth.password = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.376160 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.376278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] auth.token = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.376388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.376603 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.376722 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.376842 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.376956 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.377086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.377205 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.377327 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.377433 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.377540 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.377651 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.377765 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.377873 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.377948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.378010 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.378074 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] credential.caching = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.378134 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.378192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.378250 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.378315 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.378380 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.378485 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.378565 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.378646 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.378739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.378810 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.378871 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.378928 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.379020 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.379145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.379229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.379300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.379360 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.379427 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.379488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.379560 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.379627 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.379692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.379752 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.379823 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.379885 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.379885 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.380056 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.380131 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.380193 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.380260 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.380321 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.380380 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.380439 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] federation.caching = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.380496 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.380577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.380652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.380728 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.380901 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.380974 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381093 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381234 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381353 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381412 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381533 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381604 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381664 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381722 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381781 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381838 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381905 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.381994 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] auth.external = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.382090 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.382155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.382214 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity.caching = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.382214 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.382399 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.382465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.382525 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.382583 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.382641 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] auth.password = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.382706 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.382793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] auth.token = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.382859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.382919 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383012 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383096 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383299 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383372 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383537 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383695 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383757 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383815 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383881 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] credential.caching = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.383997 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.384063 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.384123 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.384194 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.384302 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.384411 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.384518 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.384658 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.384727 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.384794 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.384854 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.384912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.384970 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.385037 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.385097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.385155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.385219 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.385327 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.385440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.385545 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.385610 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.385610 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.385773 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.385890 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.386003 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.386130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.386250 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.386364 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.386477 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.386697 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.386858 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.386941 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.387004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] federation.caching = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.387070 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.387130 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.387189 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.387248 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.387315 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.387375 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.387449 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.387646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.387736 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.387861 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.387950 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.388070 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.388146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.388146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.388326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.388453 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.388549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.388613 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.388743 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.388841 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.388961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.389052 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.389172 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.389249 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.389358 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity.caching = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.389437 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.389547 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.389637 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.389637 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.389829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.389947 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.390024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.390704 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.390856 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.390958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.391095 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.391230 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.391371 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.391711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.391871 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.391992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.391992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.392163 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.392243 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.392353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.392442 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.392573 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.392652 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.392762 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.392842 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.392959 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.393050 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.393168 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.393245 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.393354 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.393434 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.393551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.393637 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.393755 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.393833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.393937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.394017 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.394017 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.394202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.394321 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.394398 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.394536 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.394644 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.394769 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.394863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.395014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.395093 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.395251 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.395373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.395492 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.395629 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.395746 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.395880 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.395992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.396120 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.396246 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.396340 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.396482 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.396652 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.396762 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.396870 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.396999 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.398469 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.398583 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.398704 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.398782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.398901 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.398978 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.398978 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.399171 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.399289 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.399289 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.399455 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.399534 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.399660 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.399739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.399857 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.400182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.400303 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.400379 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.400505 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.400645 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.400727 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.400843 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.400919 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.401036 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.401132 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.401202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.401320 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.401396 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.401513 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] resource.caching = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.401589 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.401787 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.401869 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.401979 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.402059 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.402168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.402260 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.402380 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.402457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.402566 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.402646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.402763 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.402849 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.402967 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.403043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.403180 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.403285 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.403406 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.403406 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] role.caching = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.403658 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.403778 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] role.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.403856 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.403965 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.404046 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.404171 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.404251 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.404251 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.404439 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.404646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.404737 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.404867 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.404952 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.405071 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.405148 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.405265 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.405343 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.405425 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.405588 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.405668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.406501 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.406639 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.406776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.406985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.407129 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.407261 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.407363 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.407438 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.407510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.407628 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.407710 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.407869 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.407949 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.408110 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.408350 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.408438 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.408679 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.408768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.408891 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.408962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.409177 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.409272 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.409440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.409616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.409759 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.409899 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.410038 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.410181 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.410289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.410400 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.410503 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.410604 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.410705 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.410821 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.410957 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.411064 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.411200 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.411307 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.411420 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.411558 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.411670 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.411772 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.411881 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] resource.caching = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.411984 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.412198 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.412304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.412440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.412574 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.412704 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.412817 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.412952 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.413135 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.413275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] token.caching = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.413412 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.413544 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.413653 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.413768 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.413871 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.413970 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.414069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.414170 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.414271 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.414380 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.414482 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] role.caching = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.414581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.414779 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.414898 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] role.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.415012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.415113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.415307 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.415497 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.415671 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.415799 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.415927 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.416062 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.416189 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.416339 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.416463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.416570 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.416694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.416823 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.416943 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.417069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.417996 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.418129 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.419418 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.422472 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.422663 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.connection = **** {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.422800 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.422924 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.423044 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.423165 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.423283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.423410 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.423533 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.423651 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.423651 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.423871 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.423988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.424114 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.424235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.424352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.424468 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.424604 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.424722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.424852 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.424970 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.425086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.425203 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.425370 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.425489 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.425615 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.425733 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.425850 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.425967 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.426083 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.426199 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.426326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.426444 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.426559 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.426675 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.426791 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.426906 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.426906 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88384) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 21:12:29.427136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.427136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.427136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.427136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.427136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.427136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.427136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] token.caching = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.427136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.427136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.428091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.428091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.428091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.428091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.428091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.428091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.428091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.428091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.428091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.connection = **** {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.433704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.434293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.434293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.434293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.434293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.434293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.434293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.434293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 21:12:29.434293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88385) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 21:12:29.457101 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.457327 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.457749 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.459587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.459678 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.460002 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.466250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.469671 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.496614 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.496883 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.497864 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.498099 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.554223 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.554445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.607984 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.608220 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.610617 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.610861 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.681910 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.682199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.682337 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.682452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.682534 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.682669 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.682781 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.682889 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.682993 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.683067 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.683145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.683219 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.709263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.709495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.709627 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.709755 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.709932 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.710088 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.710204 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.710328 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.710457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.710578 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.710711 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.710827 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.710947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.710947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.722671 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.722903 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.735871 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.736065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.736195 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.736281 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.736410 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.736515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.736701 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.736824 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.736927 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.737027 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.748003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.748003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88384) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.748313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.748313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88385) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 03 21:12:29.766540 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.766762 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 21:12:29.767090 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.767226 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.767355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 21:12:29.767482 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 21:12:29.767660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.767794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.767913 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 03 21:12:29.768032 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.768256 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.768383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.768503 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.768778 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.768902 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.768902 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.778666 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.778891 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.779073 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.779220 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.779365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.779507 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.779645 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.779785 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.786850 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.787024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.789802 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.790140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.790432 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.790584 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.790713 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.790835 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.791001 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.791120 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.791252 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.791369 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.791529 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.791647 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.791869 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.792006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.792122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.792239 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.792356 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.792478 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.792622 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.792802 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.792980 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.793247 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.818537 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.818826 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.819947 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.820233 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.820359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.820675 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.824779 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.825065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.825272 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.825462 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.825580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.825954 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.832631 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.832924 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.833098 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.833395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.837018 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.837313 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.837456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.837605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.837725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.838005 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.838123 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.838297 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.838413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.838584 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.838702 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.838866 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.838984 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.839147 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.839263 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.839514 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.854983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.855264 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.855474 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.855590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.859277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.859513 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.862471 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.862651 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.862911 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.863075 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.867339 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.867471 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.870515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.870665 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.873677 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.873805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.873978 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.874141 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.874274 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.874395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.875164 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.875442 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.875574 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.875746 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.875878 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.876049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.892350 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.892570 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.892692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.892875 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.892995 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.893152 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.893297 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.893420 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.900186 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.900442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.901889 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.902143 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.903423 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.903692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.903814 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.903978 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.906442 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.906725 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.907016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.907334 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.907483 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.907639 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.907830 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.907949 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.908205 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.908513 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.919068 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.919355 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.919641 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.919892 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.920015 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.920186 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.920308 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.920446 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.920591 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.920720 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.920842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.921049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.921375 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.921665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.936213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.937901 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.939786 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.940989 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.942702 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.943881 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.944188 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.945371 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.945712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.945994 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.946274 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.947254 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.947547 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.947838 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.953358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.954830 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.955362 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.956881 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.957717 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.958009 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.958292 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.958565 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.959755 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.960050 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.960340 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.960653 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.967564 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.967865 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.968147 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.970035 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.970337 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.970628 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.975053 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88384) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.975337 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.975616 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.975899 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.976172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.976451 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.976759 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.977038 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.977304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.977578 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.977697 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88385) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 03 21:12:29.977858 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.977979 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.978118 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.978247 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.978374 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.978500 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.978628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88384) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.978766 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.978969 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.979249 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.979625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.979835 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.980081 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.980358 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.980654 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.980926 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:29.981222 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88385) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 03 21:12:30.012245 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b292a69c0 pid: 88384 (default app) Sep 03 21:12:30.015264 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557b292a69c0 pid: 88385 (default app) Sep 03 21:12:30.016496 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd15fd-850b-4b60-a105-b7d7bf3d5d8f None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:30.016811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd15fd-850b-4b60-a105-b7d7bf3d5d8f None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:30.017084 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd15fd-850b-4b60-a105-b7d7bf3d5d8f None None] PATH_INFO: `/v3` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:30.021273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Sat Sep 3 21:12:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:12:38.407773 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e59df-fd2a-4d9a-b821-fd7d5c4c116a None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:38.415254 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e59df-fd2a-4d9a-b821-fd7d5c4c116a None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:38.415254 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e59df-fd2a-4d9a-b821-fd7d5c4c116a None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:38.415254 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:12:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:12:38.418680 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc00d28-ac17-4ba3-95a7-3434af75be6d None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:38.419240 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc00d28-ac17-4ba3-95a7-3434af75be6d None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:38.419240 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc00d28-ac17-4ba3-95a7-3434af75be6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:38.497634 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: INFO dbcounter [None req-1fc00d28-ac17-4ba3-95a7-3434af75be6d None None] Registered counter for database keystone Sep 03 21:12:38.520175 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG oslo_db.sqlalchemy.engines [None req-1fc00d28-ac17-4ba3-95a7-3434af75be6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88384) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:12:38.527641 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writer thread running {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 21:12:38.723311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG passlib.handlers.bcrypt [None req-1fc00d28-ac17-4ba3-95a7-3434af75be6d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88384) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 03 21:12:38.723621 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG passlib.handlers.bcrypt [None req-1fc00d28-ac17-4ba3-95a7-3434af75be6d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88384) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 03 21:12:38.788990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-1fc00d28-ac17-4ba3-95a7-3434af75be6d None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:12:38.790644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-1fc00d28-ac17-4ba3-95a7-3434af75be6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:12:38.933573 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:12:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 03 21:12:39.476752 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e59df-fd2a-4d9a-b821-fd7d5c4c116a None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:39.558352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: INFO dbcounter [None req-1b5e59df-fd2a-4d9a-b821-fd7d5c4c116a None None] Registered counter for database keystone Sep 03 21:12:39.578929 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG oslo_db.sqlalchemy.engines [None req-1b5e59df-fd2a-4d9a-b821-fd7d5c4c116a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88385) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 21:12:39.586033 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writer thread running {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 21:12:39.709466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e59df-fd2a-4d9a-b821-fd7d5c4c116a None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:39.713846 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2a9e2-dc73-443a-b20a-aa806c4405a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:39.714471 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2a9e2-dc73-443a-b20a-aa806c4405a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:39.714748 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2a9e2-dc73-443a-b20a-aa806c4405a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:39.715017 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2a9e2-dc73-443a-b20a-aa806c4405a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:39.724669 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2a9e2-dc73-443a-b20a-aa806c4405a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:39.782174 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: WARNING keystone.common.rbac_enforcer.enforcer [None req-72f2a9e2-dc73-443a-b20a-aa806c4405a0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 03 21:12:39.782442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2a9e2-dc73-443a-b20a-aa806c4405a0 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:39.793061 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Sat Sep 3 21:12:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 03 21:12:39.799923 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc00d28-ac17-4ba3-95a7-3434af75be6d None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:39.818289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc00d28-ac17-4ba3-95a7-3434af75be6d None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:39.822942 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df88c0d-dc46-4db2-9d8a-1f44be242f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:39.824073 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df88c0d-dc46-4db2-9d8a-1f44be242f7f admin admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:39.824359 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df88c0d-dc46-4db2-9d8a-1f44be242f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:39.824680 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df88c0d-dc46-4db2-9d8a-1f44be242f7f admin admin] PATH_INFO: `/v3/projects/a2e3df601a7e4116a238ebd2db036ed5` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:39.826207 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df88c0d-dc46-4db2-9d8a-1f44be242f7f admin admin] RBAC: Authorizing `identity:get_project(project_id=a2e3df601a7e4116a238ebd2db036ed5)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:39.877207 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5df88c0d-dc46-4db2-9d8a-1f44be242f7f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 03 21:12:39.877557 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df88c0d-dc46-4db2-9d8a-1f44be242f7f admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:39.882378 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Sat Sep 3 21:12:39 2022] GET /identity/v3/projects/a2e3df601a7e4116a238ebd2db036ed5 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:12:42.165263 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5654d0-98fe-46bb-92f0-8a2504cb8dae None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:42.165813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5654d0-98fe-46bb-92f0-8a2504cb8dae None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:42.165957 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5654d0-98fe-46bb-92f0-8a2504cb8dae None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:42.172356 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:12:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:12:42.179851 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c70b7-122b-4491-a625-ef82b11ebb5b None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:42.180396 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c70b7-122b-4491-a625-ef82b11ebb5b None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:42.180396 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c70b7-122b-4491-a625-ef82b11ebb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:42.204741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-0f8c70b7-122b-4491-a625-ef82b11ebb5b None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:12:42.206317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-0f8c70b7-122b-4491-a625-ef82b11ebb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:12:42.214299 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:12:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 03 21:12:42.547457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5654d0-98fe-46bb-92f0-8a2504cb8dae None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:42.559915 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5654d0-98fe-46bb-92f0-8a2504cb8dae None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:42.564392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41025132-0a3c-458f-bb61-83eca3065c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:42.565050 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41025132-0a3c-458f-bb61-83eca3065c62 admin admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:42.565322 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41025132-0a3c-458f-bb61-83eca3065c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:42.565593 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41025132-0a3c-458f-bb61-83eca3065c62 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:42.574196 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41025132-0a3c-458f-bb61-83eca3065c62 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:42.575999 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41025132-0a3c-458f-bb61-83eca3065c62 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:42.585658 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Sat Sep 3 21:12:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 03 21:12:42.591583 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c70b7-122b-4491-a625-ef82b11ebb5b None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:42.601695 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c70b7-122b-4491-a625-ef82b11ebb5b None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:42.606136 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24ca06-de68-4f20-9e62-065ae4db4b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:42.606780 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ca06-de68-4f20-9e62-065ae4db4b33 admin admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:42.607056 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ca06-de68-4f20-9e62-065ae4db4b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:42.607326 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24ca06-de68-4f20-9e62-065ae4db4b33 admin admin] PATH_INFO: `/v3/users/3e2bd2fbe30f4ddbb48bb8150f222665` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:42.609526 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24ca06-de68-4f20-9e62-065ae4db4b33 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e2bd2fbe30f4ddbb48bb8150f222665)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:42.611579 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24ca06-de68-4f20-9e62-065ae4db4b33 admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:42.613229 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Sat Sep 3 21:12:42 2022] GET /identity/v3/users/3e2bd2fbe30f4ddbb48bb8150f222665 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:12:44.944690 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be4eb0-4769-4f4b-b6ee-f99ce5e7c063 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:44.945235 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be4eb0-4769-4f4b-b6ee-f99ce5e7c063 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:44.945235 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be4eb0-4769-4f4b-b6ee-f99ce5e7c063 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:44.946559 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:12:44.951953 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c932b-07be-491b-91d4-b10bda456359 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:44.952787 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c932b-07be-491b-91d4-b10bda456359 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:44.952787 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c932b-07be-491b-91d4-b10bda456359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:44.954666 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078ab05-ccf8-49d5-9126-ade1b294c784 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:44.954944 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078ab05-ccf8-49d5-9126-ade1b294c784 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:44.955214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078ab05-ccf8-49d5-9126-ade1b294c784 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:44.957038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:12:44.962083 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bf899-e4c3-4a93-a8f0-f7f164a3c862 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:44.962364 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bf899-e4c3-4a93-a8f0-f7f164a3c862 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:44.962637 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bf899-e4c3-4a93-a8f0-f7f164a3c862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:44.971541 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-896c932b-07be-491b-91d4-b10bda456359 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:12:44.972754 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-896c932b-07be-491b-91d4-b10bda456359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:12:45.004735 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG passlib.handlers.bcrypt [None req-d15bf899-e4c3-4a93-a8f0-f7f164a3c862 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88385) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 03 21:12:45.005140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG passlib.handlers.bcrypt [None req-d15bf899-e4c3-4a93-a8f0-f7f164a3c862 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88385) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 03 21:12:45.055695 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-d15bf899-e4c3-4a93-a8f0-f7f164a3c862 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:12:45.057386 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-d15bf899-e4c3-4a93-a8f0-f7f164a3c862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:12:45.169491 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:45.173254 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:12:45.500646 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c932b-07be-491b-91d4-b10bda456359 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:45.507559 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bf899-e4c3-4a93-a8f0-f7f164a3c862 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:45.526365 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:45.611284 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c932b-07be-491b-91d4-b10bda456359 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:45.611614 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bf899-e4c3-4a93-a8f0-f7f164a3c862 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:45.614474 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:45.650483 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57b821-3acd-4ad7-bbdf-29a14c18c291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:45.651119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57b821-3acd-4ad7-bbdf-29a14c18c291 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:45.651400 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57b821-3acd-4ad7-bbdf-29a14c18c291 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:45.651677 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57b821-3acd-4ad7-bbdf-29a14c18c291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:45.653818 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1f143-17a3-43d2-aedd-9d27205648ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:45.655599 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1f143-17a3-43d2-aedd-9d27205648ab None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:45.655769 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1f143-17a3-43d2-aedd-9d27205648ab None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:45.656042 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1f143-17a3-43d2-aedd-9d27205648ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:45.670326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1f143-17a3-43d2-aedd-9d27205648ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-00b1f143-17a3-43d2-aedd-9d27205648ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:12:45.680291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:12:45.681348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:12:45.682466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:12:45.682466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:12:45.682466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:12:45.682466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:12:45.682466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:12:45.682466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:12:45.682466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:12:45.682466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:12:45.682466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:12:45.682466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:12:45.682466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:12:45.682466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:12:45.682466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 8/14] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:12:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:12:45.687948 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1f143-17a3-43d2-aedd-9d27205648ab None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:45.731992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57b821-3acd-4ad7-bbdf-29a14c18c291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:45.734306 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57b821-3acd-4ad7-bbdf-29a14c18c291 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:45.762049 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:45.802532 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1f143-17a3-43d2-aedd-9d27205648ab None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:45.838598 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0f41a-e871-4a67-aa6b-f1ef8047b615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:45.839207 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0f41a-e871-4a67-aa6b-f1ef8047b615 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:45.839492 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0f41a-e871-4a67-aa6b-f1ef8047b615 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:45.839757 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0f41a-e871-4a67-aa6b-f1ef8047b615 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:45.840436 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0f41a-e871-4a67-aa6b-f1ef8047b615 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:12:45.840767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0f41a-e871-4a67-aa6b-f1ef8047b615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:45.843019 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0f41a-e871-4a67-aa6b-f1ef8047b615 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:45.857322 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 9/15] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:12:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:12:45.858322 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 7/16] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:12:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:12:45.863710 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0f41a-e871-4a67-aa6b-f1ef8047b615 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:45.863968 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57b821-3acd-4ad7-bbdf-29a14c18c291 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:45.892367 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:45.968362 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57b821-3acd-4ad7-bbdf-29a14c18c291 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:45.968936 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0f41a-e871-4a67-aa6b-f1ef8047b615 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:45.993689 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:46.006094 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04a8f8-7398-4cd4-a141-2891c4989471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:46.006738 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04a8f8-7398-4cd4-a141-2891c4989471 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:46.007019 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04a8f8-7398-4cd4-a141-2891c4989471 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:46.007395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04a8f8-7398-4cd4-a141-2891c4989471 None admin] PATH_INFO: `/v3/users/3e2bd2fbe30f4ddbb48bb8150f222665` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:46.008015 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dbf03-fd0e-4c56-8398-b1b19303ada9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:46.008551 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04a8f8-7398-4cd4-a141-2891c4989471 None admin] RBAC: Authorizing `identity:get_user(user_id=3e2bd2fbe30f4ddbb48bb8150f222665)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:46.008825 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dbf03-fd0e-4c56-8398-b1b19303ada9 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:46.009106 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dbf03-fd0e-4c56-8398-b1b19303ada9 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:46.009380 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dbf03-fd0e-4c56-8398-b1b19303ada9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:46.010094 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04a8f8-7398-4cd4-a141-2891c4989471 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:46.011910 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 8/17] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:12:45 2022] GET /identity/v3/users/3e2bd2fbe30f4ddbb48bb8150f222665 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:12:46.017314 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04a8f8-7398-4cd4-a141-2891c4989471 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:46.138495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04a8f8-7398-4cd4-a141-2891c4989471 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:46.142468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dbf03-fd0e-4c56-8398-b1b19303ada9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:46.144070 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dbf03-fd0e-4c56-8398-b1b19303ada9 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-7b6dbf03-fd0e-4c56-8398-b1b19303ada9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:12:46.161616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:12:46.162541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:12:46.163343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:12:46.163343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:12:46.163343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:12:46.163343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:12:46.169010 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dbf03-fd0e-4c56-8398-b1b19303ada9 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:46.175157 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cd397-a527-410a-a8ea-f9002d4fa15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:46.175804 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cd397-a527-410a-a8ea-f9002d4fa15c None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:46.176080 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cd397-a527-410a-a8ea-f9002d4fa15c None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:46.176350 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cd397-a527-410a-a8ea-f9002d4fa15c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:46.177495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cd397-a527-410a-a8ea-f9002d4fa15c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:46.178976 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37cd397-a527-410a-a8ea-f9002d4fa15c None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:46.180616 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:12:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:12:46.186943 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cd397-a527-410a-a8ea-f9002d4fa15c None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:46.250679 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:46.252376 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:46.275129 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dbf03-fd0e-4c56-8398-b1b19303ada9 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:46.293510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37cd397-a527-410a-a8ea-f9002d4fa15c None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:46.308946 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469830b-3d67-4fb2-b103-74c7baf65e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:46.309557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469830b-3d67-4fb2-b103-74c7baf65e46 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:46.309833 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469830b-3d67-4fb2-b103-74c7baf65e46 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:46.310103 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469830b-3d67-4fb2-b103-74c7baf65e46 None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:46.310744 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469830b-3d67-4fb2-b103-74c7baf65e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:12:46.311604 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469830b-3d67-4fb2-b103-74c7baf65e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:46.313104 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469830b-3d67-4fb2-b103-74c7baf65e46 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:46.329903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d842c54-ede4-4722-ac19-26fe85ad80cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:46.330513 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842c54-ede4-4722-ac19-26fe85ad80cf None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:46.330797 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842c54-ede4-4722-ac19-26fe85ad80cf None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:46.331071 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842c54-ede4-4722-ac19-26fe85ad80cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:46.331781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:12:46.331901 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d842c54-ede4-4722-ac19-26fe85ad80cf None admin] RBAC: Adding query filter params (role.id=a1c22a1558c34c1d9d262bf1da31887e, scope.domain.id=default, user.id=3e2bd2fbe30f4ddbb48bb8150f222665) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:12:46.332165 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d842c54-ede4-4722-ac19-26fe85ad80cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:46.333748 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d842c54-ede4-4722-ac19-26fe85ad80cf None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:46.341279 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1322 bytes} [Sat Sep 3 21:12:46 2022] GET /identity/v3/role_assignments?user.id=3e2bd2fbe30f4ddbb48bb8150f222665&scope.domain.id=default&role.id=a1c22a1558c34c1d9d262bf1da31887e => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:12:49.157438 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536bbe0-0e87-437f-a033-883e7ef6ba5e None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:49.157973 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536bbe0-0e87-437f-a033-883e7ef6ba5e None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:49.158048 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536bbe0-0e87-437f-a033-883e7ef6ba5e None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:49.159818 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:12:49.170387 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be5617-9e54-453e-b712-3f4c9d923f32 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:49.171569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be5617-9e54-453e-b712-3f4c9d923f32 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:49.172059 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be5617-9e54-453e-b712-3f4c9d923f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:49.202312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-c1be5617-9e54-453e-b712-3f4c9d923f32 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:12:49.203886 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-c1be5617-9e54-453e-b712-3f4c9d923f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:12:49.297269 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:49.309684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d7b3-dd26-4444-824f-a9c3b50cff99 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:49.310317 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d7b3-dd26-4444-824f-a9c3b50cff99 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:49.310836 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d7b3-dd26-4444-824f-a9c3b50cff99 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:49.313042 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:12:49.318566 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cfce9-d394-4766-866d-4bd24398e595 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:49.319102 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cfce9-d394-4766-866d-4bd24398e595 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:49.319566 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cfce9-d394-4766-866d-4bd24398e595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:49.345604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-de0cfce9-d394-4766-866d-4bd24398e595 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:12:49.347206 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-de0cfce9-d394-4766-866d-4bd24398e595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:12:49.355130 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12452450-d2e3-4089-88da-b37254b556e3 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:49.355727 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12452450-d2e3-4089-88da-b37254b556e3 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:49.356211 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12452450-d2e3-4089-88da-b37254b556e3 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:49.357803 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 14/25] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:12:49.371340 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015769d-7d5f-4815-8bc9-ca55b7c17cde None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:49.371921 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015769d-7d5f-4815-8bc9-ca55b7c17cde None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:49.372351 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015769d-7d5f-4815-8bc9-ca55b7c17cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:49.406113 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-a015769d-7d5f-4815-8bc9-ca55b7c17cde None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:12:49.407459 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-a015769d-7d5f-4815-8bc9-ca55b7c17cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:12:49.435647 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:49.468922 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 12/26] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:49.551750 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 15/27] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:12:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:12:49.842133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cfce9-d394-4766-866d-4bd24398e595 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:49.882201 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e937b9-a448-4082-8c4c-d855da4006ee None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:49.882520 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e937b9-a448-4082-8c4c-d855da4006ee None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:49.882767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e937b9-a448-4082-8c4c-d855da4006ee None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:49.884228 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 16/28] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:12:49.884889 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e937b9-a448-4082-8c4c-d855da4006ee None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:49.977701 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cfce9-d394-4766-866d-4bd24398e595 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:50.026064 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:50.058100 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f99cb9-970a-4477-a859-ef680a71edc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:50.058750 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f99cb9-970a-4477-a859-ef680a71edc2 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:50.059030 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f99cb9-970a-4477-a859-ef680a71edc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:50.059305 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f99cb9-970a-4477-a859-ef680a71edc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:50.086245 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f99cb9-970a-4477-a859-ef680a71edc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-44f99cb9-970a-4477-a859-ef680a71edc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:12:50.095925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:12:50.097125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:12:50.098086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:12:50.098086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:12:50.098086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:12:50.098086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:12:50.098086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:12:50.098086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:12:50.098086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:12:50.098086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:12:50.098086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:12:50.098086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:12:50.098086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:12:50.098086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:12:50.098681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e937b9-a448-4082-8c4c-d855da4006ee None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:50.100191 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 13/29] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:12:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:12:50.101598 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce1b3-3618-4685-81a9-e4864d9bd3be None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:50.102078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce1b3-3618-4685-81a9-e4864d9bd3be None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:50.102518 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ce1b3-3618-4685-81a9-e4864d9bd3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:50.122271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-f09ce1b3-3618-4685-81a9-e4864d9bd3be None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:12:50.124385 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-f09ce1b3-3618-4685-81a9-e4864d9bd3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:12:50.135477 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b8776-a989-4b13-8315-4f0707589e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:50.136135 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b8776-a989-4b13-8315-4f0707589e99 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:50.136427 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b8776-a989-4b13-8315-4f0707589e99 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:50.136738 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b8776-a989-4b13-8315-4f0707589e99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:50.149842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b8776-a989-4b13-8315-4f0707589e99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:50.151423 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b8776-a989-4b13-8315-4f0707589e99 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:50.166124 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-fb6b8776-a989-4b13-8315-4f0707589e99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:12:50.169199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:12:50.170393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:12:50.171214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:12:50.171214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:12:50.171214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:12:50.171214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 17/30] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:12:50.171418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b8776-a989-4b13-8315-4f0707589e99 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:50.210432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 14/31] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:50.211966 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ce1b3-3618-4685-81a9-e4864d9bd3be None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:50.303615 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b8776-a989-4b13-8315-4f0707589e99 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:50.325411 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:50.330556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ce1b3-3618-4685-81a9-e4864d9bd3be None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:50.341134 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1216e-01f4-44e9-b38e-ffaee0735bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:50.342194 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1216e-01f4-44e9-b38e-ffaee0735bd2 None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:50.348334 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1216e-01f4-44e9-b38e-ffaee0735bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:50.348334 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1216e-01f4-44e9-b38e-ffaee0735bd2 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:50.348334 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1216e-01f4-44e9-b38e-ffaee0735bd2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:50.348334 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1216e-01f4-44e9-b38e-ffaee0735bd2 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:50.371861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfb676-0c96-4ac4-b6fc-4ca63b478e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:50.372898 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfb676-0c96-4ac4-b6fc-4ca63b478e63 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:50.375168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfb676-0c96-4ac4-b6fc-4ca63b478e63 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:50.375631 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bfb676-0c96-4ac4-b6fc-4ca63b478e63 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:50.376551 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfb676-0c96-4ac4-b6fc-4ca63b478e63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:12:50.377076 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfb676-0c96-4ac4-b6fc-4ca63b478e63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:50.378793 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bfb676-0c96-4ac4-b6fc-4ca63b478e63 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:50.397153 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 15/32] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:12:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:12:50.398274 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfb676-0c96-4ac4-b6fc-4ca63b478e63 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:50.449042 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:50.519934 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bfb676-0c96-4ac4-b6fc-4ca63b478e63 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:50.558347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d27fd5-2cc0-40d4-a0da-5fb364447ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:50.559308 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d27fd5-2cc0-40d4-a0da-5fb364447ac8 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:50.559779 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d27fd5-2cc0-40d4-a0da-5fb364447ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:50.560239 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d27fd5-2cc0-40d4-a0da-5fb364447ac8 None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:50.561885 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d27fd5-2cc0-40d4-a0da-5fb364447ac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:12:50.562443 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d27fd5-2cc0-40d4-a0da-5fb364447ac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:50.564023 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d27fd5-2cc0-40d4-a0da-5fb364447ac8 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:50.579634 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 18/33] 10.222.0.43 () {60 vars in 1131 bytes} [Sat Sep 3 21:12:50 2022] POST /identity/v3/roles => generated 225 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:12:50.580857 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1216e-01f4-44e9-b38e-ffaee0735bd2 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:50.588571 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 16/34] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:12:50.590634 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ae728-e977-47f1-830f-13f5e498f58e None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:50.591263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ae728-e977-47f1-830f-13f5e498f58e None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:50.591753 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ae728-e977-47f1-830f-13f5e498f58e None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:50.594039 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 17/35] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:12:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:12:50.596093 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ae728-e977-47f1-830f-13f5e498f58e None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:50.714225 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:50.726477 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ae728-e977-47f1-830f-13f5e498f58e None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:50.751511 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1216e-01f4-44e9-b38e-ffaee0735bd2 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:50.779406 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1c0d5-6579-4068-bb0b-3d2a32bec30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:50.780958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1c0d5-6579-4068-bb0b-3d2a32bec30d None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:50.781409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1c0d5-6579-4068-bb0b-3d2a32bec30d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:50.782019 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1c0d5-6579-4068-bb0b-3d2a32bec30d None admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:50.782931 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1c0d5-6579-4068-bb0b-3d2a32bec30d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:50.785011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1c0d5-6579-4068-bb0b-3d2a32bec30d None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:50.802976 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691f4e3-0c9b-48b3-852c-43ee479510d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:50.803872 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691f4e3-0c9b-48b3-852c-43ee479510d0 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:50.804256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691f4e3-0c9b-48b3-852c-43ee479510d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:50.804555 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691f4e3-0c9b-48b3-852c-43ee479510d0 None admin] PATH_INFO: `/v3/users/3e2bd2fbe30f4ddbb48bb8150f222665` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:50.806446 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691f4e3-0c9b-48b3-852c-43ee479510d0 None admin] RBAC: Authorizing `identity:get_user(user_id=3e2bd2fbe30f4ddbb48bb8150f222665)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:50.808105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691f4e3-0c9b-48b3-852c-43ee479510d0 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:50.810494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 19/36] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:12:50 2022] GET /identity/v3/users/3e2bd2fbe30f4ddbb48bb8150f222665 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:12:50.811526 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542874f8-1d36-470c-b649-005e1dccc936 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:50.811900 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542874f8-1d36-470c-b649-005e1dccc936 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:50.812164 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542874f8-1d36-470c-b649-005e1dccc936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:50.834773 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-542874f8-1d36-470c-b649-005e1dccc936 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:12:50.836425 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-542874f8-1d36-470c-b649-005e1dccc936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:12:50.885222 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:50.908828 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 20/37] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:50.916832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542874f8-1d36-470c-b649-005e1dccc936 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:51.032569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 18/38] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Sep 3 21:12:50 2022] POST /identity/v3/projects => generated 301 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 21:12:51.032569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1c0d5-6579-4068-bb0b-3d2a32bec30d None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:51.041485 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542874f8-1d36-470c-b649-005e1dccc936 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:51.100190 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059d82b-2aa9-4b40-8757-591f80b838d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:51.101077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059d82b-2aa9-4b40-8757-591f80b838d6 None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:51.101685 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059d82b-2aa9-4b40-8757-591f80b838d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:51.101964 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059d82b-2aa9-4b40-8757-591f80b838d6 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:51.102969 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059d82b-2aa9-4b40-8757-591f80b838d6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:51.105194 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059d82b-2aa9-4b40-8757-591f80b838d6 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:51.160007 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1c0d5-6579-4068-bb0b-3d2a32bec30d None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:51.173794 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 21/39] 10.222.0.43 () {60 vars in 1131 bytes} [Sat Sep 3 21:12:50 2022] POST /identity/v3/roles => generated 219 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:12:51.176818 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068978af-ce05-429e-b0dd-f6ac5c29f62a None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:51.177380 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068978af-ce05-429e-b0dd-f6ac5c29f62a None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:51.178177 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068978af-ce05-429e-b0dd-f6ac5c29f62a None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:51.181066 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 22/40] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:12:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:12:51.192375 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878de12-c72f-4565-8669-78b7296aeb7e None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:51.193048 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878de12-c72f-4565-8669-78b7296aeb7e None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:51.193558 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878de12-c72f-4565-8669-78b7296aeb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:51.219353 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db2642-e9cd-4a95-8c18-eabf993fc474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:51.219353 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db2642-e9cd-4a95-8c18-eabf993fc474 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:51.219956 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db2642-e9cd-4a95-8c18-eabf993fc474 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:51.220239 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db2642-e9cd-4a95-8c18-eabf993fc474 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:51.223214 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db2642-e9cd-4a95-8c18-eabf993fc474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:51.228236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db2642-e9cd-4a95-8c18-eabf993fc474 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:51.230912 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 19/41] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:12:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:12:51.238367 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db2642-e9cd-4a95-8c18-eabf993fc474 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:51.243316 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-7878de12-c72f-4565-8669-78b7296aeb7e None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:12:51.244593 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-7878de12-c72f-4565-8669-78b7296aeb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:12:51.265020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:51.291188 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:51.356428 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 23/42] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:51.361486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878de12-c72f-4565-8669-78b7296aeb7e None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:51.397114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db2642-e9cd-4a95-8c18-eabf993fc474 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:51.450640 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16a73f-f15c-4305-bf3e-e5e7b7426bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:51.451621 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16a73f-f15c-4305-bf3e-e5e7b7426bf1 None admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:51.451899 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16a73f-f15c-4305-bf3e-e5e7b7426bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:51.452367 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16a73f-f15c-4305-bf3e-e5e7b7426bf1 None admin] PATH_INFO: `/v3/domains/default/users/3e2bd2fbe30f4ddbb48bb8150f222665/roles/a1c22a1558c34c1d9d262bf1da31887e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:51.455113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16a73f-f15c-4305-bf3e-e5e7b7426bf1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3e2bd2fbe30f4ddbb48bb8150f222665, role_id=a1c22a1558c34c1d9d262bf1da31887e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:51.456696 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16a73f-f15c-4305-bf3e-e5e7b7426bf1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:51.492321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878de12-c72f-4565-8669-78b7296aeb7e None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:51.526939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757dce7-8e88-4501-bae9-5fe0f07bb465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:51.527546 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757dce7-8e88-4501-bae9-5fe0f07bb465 None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:51.527796 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757dce7-8e88-4501-bae9-5fe0f07bb465 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:51.528072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757dce7-8e88-4501-bae9-5fe0f07bb465 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:51.528784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757dce7-8e88-4501-bae9-5fe0f07bb465 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:51.530920 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757dce7-8e88-4501-bae9-5fe0f07bb465 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:51.563357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 20/43] 10.222.0.43 () {58 vars in 1361 bytes} [Sat Sep 3 21:12:51 2022] PUT /identity/v3/domains/default/users/3e2bd2fbe30f4ddbb48bb8150f222665/roles/a1c22a1558c34c1d9d262bf1da31887e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 21:12:51.628266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 24/44] 10.222.0.43 () {60 vars in 1131 bytes} [Sat Sep 3 21:12:51 2022] POST /identity/v3/roles => generated 223 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:12:51.692987 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16a73f-f15c-4305-bf3e-e5e7b7426bf1 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:51.800074 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:51.832439 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16a73f-f15c-4305-bf3e-e5e7b7426bf1 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:51.876443 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0404fd1-207d-4f9c-b6e4-d4ce9f000840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:51.877128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0404fd1-207d-4f9c-b6e4-d4ce9f000840 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:51.877501 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0404fd1-207d-4f9c-b6e4-d4ce9f000840 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:51.877783 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0404fd1-207d-4f9c-b6e4-d4ce9f000840 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:51.878945 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0404fd1-207d-4f9c-b6e4-d4ce9f000840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:51.880515 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0404fd1-207d-4f9c-b6e4-d4ce9f000840 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:51.882352 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 21/45] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:12:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:12:51.887840 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757dce7-8e88-4501-bae9-5fe0f07bb465 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:51.921651 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:51.999414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757dce7-8e88-4501-bae9-5fe0f07bb465 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:52.038458 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01182677-b2d2-48de-8c25-21ceb1e14927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:52.039087 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01182677-b2d2-48de-8c25-21ceb1e14927 None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:52.039372 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01182677-b2d2-48de-8c25-21ceb1e14927 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:52.039651 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01182677-b2d2-48de-8c25-21ceb1e14927 None admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:52.040321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01182677-b2d2-48de-8c25-21ceb1e14927 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:52.041829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01182677-b2d2-48de-8c25-21ceb1e14927 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:52.126177 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 25/46] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Sep 3 21:12:51 2022] POST /identity/v3/projects => generated 312 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 21:12:53.804962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2543960-c608-4155-805b-ca46fa943ca4 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:53.805500 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2543960-c608-4155-805b-ca46fa943ca4 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:53.805583 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2543960-c608-4155-805b-ca46fa943ca4 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:53.806877 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 22/47] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:12:53.812347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493ca16-b238-4afc-bfbc-4b17159f1f90 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:53.812804 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493ca16-b238-4afc-bfbc-4b17159f1f90 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:53.813058 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493ca16-b238-4afc-bfbc-4b17159f1f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:53.831323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-9493ca16-b238-4afc-bfbc-4b17159f1f90 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:12:53.832551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-9493ca16-b238-4afc-bfbc-4b17159f1f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:12:53.901825 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 26/48] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:54.234461 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2543960-c608-4155-805b-ca46fa943ca4 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:54.343751 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2543960-c608-4155-805b-ca46fa943ca4 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:54.361543 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c1a4a-a814-45a2-8f91-95bd14e9a4d7 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:54.361942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c1a4a-a814-45a2-8f91-95bd14e9a4d7 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:54.362289 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c1a4a-a814-45a2-8f91-95bd14e9a4d7 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:54.363702 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 27/49] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:12:54.368688 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260afb2e-6ea3-4449-95fe-b15255d32350 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:54.368976 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260afb2e-6ea3-4449-95fe-b15255d32350 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:54.369258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260afb2e-6ea3-4449-95fe-b15255d32350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:54.378161 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5243990-edd7-4eb4-8e15-ea9cf022c5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:54.378789 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5243990-edd7-4eb4-8e15-ea9cf022c5ad None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:54.379067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5243990-edd7-4eb4-8e15-ea9cf022c5ad None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:54.379340 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5243990-edd7-4eb4-8e15-ea9cf022c5ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:54.390064 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-260afb2e-6ea3-4449-95fe-b15255d32350 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:12:54.391269 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-260afb2e-6ea3-4449-95fe-b15255d32350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:12:54.394155 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5243990-edd7-4eb4-8e15-ea9cf022c5ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:12:54.394280 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-b5243990-edd7-4eb4-8e15-ea9cf022c5ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:12:54.399373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:12:54.400271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:12:54.403266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:12:54.403266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:12:54.403266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:12:54.403266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:12:54.403266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:12:54.403266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:12:54.403266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:12:54.403266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:12:54.403266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:12:54.403266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:12:54.403266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:12:54.403266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:12:54.403266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 23/50] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:12:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:12:54.407393 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5243990-edd7-4eb4-8e15-ea9cf022c5ad None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:54.410303 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:54.461854 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 28/51] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:12:54.512089 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5243990-edd7-4eb4-8e15-ea9cf022c5ad None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:54.545707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089fadf-4218-4698-bf20-bc1c786c4087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:54.546306 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089fadf-4218-4698-bf20-bc1c786c4087 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:54.546592 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089fadf-4218-4698-bf20-bc1c786c4087 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:54.546867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089fadf-4218-4698-bf20-bc1c786c4087 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:54.547527 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089fadf-4218-4698-bf20-bc1c786c4087 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:12:54.547833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089fadf-4218-4698-bf20-bc1c786c4087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:54.549273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089fadf-4218-4698-bf20-bc1c786c4087 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:54.557302 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 24/52] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:12:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:12:54.563711 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260afb2e-6ea3-4449-95fe-b15255d32350 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:54.666376 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260afb2e-6ea3-4449-95fe-b15255d32350 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:54.701015 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c1aa1-a4f5-41bc-adc6-c0e4ce83b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:54.702196 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c1aa1-a4f5-41bc-adc6-c0e4ce83b81d None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:54.702477 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c1aa1-a4f5-41bc-adc6-c0e4ce83b81d None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:54.702757 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c1aa1-a4f5-41bc-adc6-c0e4ce83b81d None admin] PATH_INFO: `/v3/users/3e2bd2fbe30f4ddbb48bb8150f222665` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:54.703981 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c1aa1-a4f5-41bc-adc6-c0e4ce83b81d None admin] RBAC: Authorizing `identity:get_user(user_id=3e2bd2fbe30f4ddbb48bb8150f222665)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:54.705510 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c1aa1-a4f5-41bc-adc6-c0e4ce83b81d None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:54.707289 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 29/53] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:12:54 2022] GET /identity/v3/users/3e2bd2fbe30f4ddbb48bb8150f222665 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:12:54.712887 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089fadf-4218-4698-bf20-bc1c786c4087 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:54.778034 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:54.811866 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c1aa1-a4f5-41bc-adc6-c0e4ce83b81d None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:54.818695 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089fadf-4218-4698-bf20-bc1c786c4087 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:54.823011 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:54.853127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24769b9-95c8-4099-afc7-d380f474574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:54.853831 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24769b9-95c8-4099-afc7-d380f474574f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:54.854074 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24769b9-95c8-4099-afc7-d380f474574f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:54.854346 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24769b9-95c8-4099-afc7-d380f474574f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:54.855467 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24769b9-95c8-4099-afc7-d380f474574f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:54.856965 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24769b9-95c8-4099-afc7-d380f474574f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:54.859111 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 25/54] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:12:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:12:54.865063 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24769b9-95c8-4099-afc7-d380f474574f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:54.917791 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c1aa1-a4f5-41bc-adc6-c0e4ce83b81d None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:54.954228 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac989770-2963-475e-b451-f8755baa6320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:54.954872 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac989770-2963-475e-b451-f8755baa6320 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:54.955158 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac989770-2963-475e-b451-f8755baa6320 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:54.955466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac989770-2963-475e-b451-f8755baa6320 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:54.956597 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac989770-2963-475e-b451-f8755baa6320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:54.958098 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac989770-2963-475e-b451-f8755baa6320 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:54.959688 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 30/55] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:12:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:12:54.965473 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac989770-2963-475e-b451-f8755baa6320 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:54.973290 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24769b9-95c8-4099-afc7-d380f474574f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:55.005312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:55.010972 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf624a8-6dbd-4a9f-a1f6-82e61df7b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:55.011586 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf624a8-6dbd-4a9f-a1f6-82e61df7b7d5 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:55.011865 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf624a8-6dbd-4a9f-a1f6-82e61df7b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:55.016317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf624a8-6dbd-4a9f-a1f6-82e61df7b7d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:55.016317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf624a8-6dbd-4a9f-a1f6-82e61df7b7d5 None admin] RBAC: Adding query filter params (role.id=a1c22a1558c34c1d9d262bf1da31887e, scope.domain.id=default, user.id=3e2bd2fbe30f4ddbb48bb8150f222665) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:12:55.016317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf624a8-6dbd-4a9f-a1f6-82e61df7b7d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:55.016317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf624a8-6dbd-4a9f-a1f6-82e61df7b7d5 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:55.021740 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 26/56] 10.222.0.43 () {56 vars in 1322 bytes} [Sat Sep 3 21:12:54 2022] GET /identity/v3/role_assignments?user.id=3e2bd2fbe30f4ddbb48bb8150f222665&scope.domain.id=default&role.id=a1c22a1558c34c1d9d262bf1da31887e => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:12:55.054472 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:55.084369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac989770-2963-475e-b451-f8755baa6320 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:55.125475 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e80d9-04a6-4f92-8814-7ac2a53e531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:55.126107 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e80d9-04a6-4f92-8814-7ac2a53e531a None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:55.126397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e80d9-04a6-4f92-8814-7ac2a53e531a None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:55.126671 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e80d9-04a6-4f92-8814-7ac2a53e531a None admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:55.127333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e80d9-04a6-4f92-8814-7ac2a53e531a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:55.128894 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e80d9-04a6-4f92-8814-7ac2a53e531a None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:55.194467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 31/57] 10.222.0.43 () {60 vars in 1140 bytes} [Sat Sep 3 21:12:54 2022] POST /identity/v3/projects => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 21:12:57.436405 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf9a4b-da26-4db0-b1e5-6c61f0c6cad3 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:57.436989 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf9a4b-da26-4db0-b1e5-6c61f0c6cad3 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:57.437079 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf9a4b-da26-4db0-b1e5-6c61f0c6cad3 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:57.438371 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 27/58] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:12:57.443717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63674-cc91-4696-89a3-9a73c33dbcf1 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:57.444116 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63674-cc91-4696-89a3-9a73c33dbcf1 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:57.444283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63674-cc91-4696-89a3-9a73c33dbcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:57.462442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-1ba63674-cc91-4696-89a3-9a73c33dbcf1 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:12:57.463652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-1ba63674-cc91-4696-89a3-9a73c33dbcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:12:57.532305 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 32/59] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:12:57.869589 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf9a4b-da26-4db0-b1e5-6c61f0c6cad3 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:57.973625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf9a4b-da26-4db0-b1e5-6c61f0c6cad3 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:58.008768 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12661252-ba2d-45af-8b37-36f67b2cadcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:58.009403 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12661252-ba2d-45af-8b37-36f67b2cadcb None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:58.009682 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12661252-ba2d-45af-8b37-36f67b2cadcb None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:58.009956 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12661252-ba2d-45af-8b37-36f67b2cadcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:58.011087 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12661252-ba2d-45af-8b37-36f67b2cadcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:58.012592 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12661252-ba2d-45af-8b37-36f67b2cadcb None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:58.014542 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 28/60] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:12:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:12:58.020519 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba63674-cc91-4696-89a3-9a73c33dbcf1 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:12:58.084707 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:12:58.126191 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba63674-cc91-4696-89a3-9a73c33dbcf1 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:12:58.161705 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e538d-a548-460f-b548-dba1c249dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:12:58.162318 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e538d-a548-460f-b548-dba1c249dcad None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:12:58.162624 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e538d-a548-460f-b548-dba1c249dcad None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:12:58.162886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e538d-a548-460f-b548-dba1c249dcad None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:12:58.163534 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e538d-a548-460f-b548-dba1c249dcad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:12:58.165034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e538d-a548-460f-b548-dba1c249dcad None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:12:58.243431 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 33/61] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Sep 3 21:12:58 2022] POST /identity/v3/users => generated 275 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:13:01.758827 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9527c-4273-4347-9c28-5d53fa719369 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:01.758827 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9527c-4273-4347-9c28-5d53fa719369 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:01.758827 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9527c-4273-4347-9c28-5d53fa719369 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:01.758827 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 29/62] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:01.765381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2910120-9482-4aab-ab3f-cbc9ceb5b6b3 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:01.765815 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2910120-9482-4aab-ab3f-cbc9ceb5b6b3 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:01.765933 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2910120-9482-4aab-ab3f-cbc9ceb5b6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:01.792875 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-b2910120-9482-4aab-ab3f-cbc9ceb5b6b3 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:01.794936 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-b2910120-9482-4aab-ab3f-cbc9ceb5b6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:01.845190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca743a0-8b84-4c00-acf6-2b135f962d8a None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:01.845818 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca743a0-8b84-4c00-acf6-2b135f962d8a None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:01.846322 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca743a0-8b84-4c00-acf6-2b135f962d8a None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:01.848058 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 30/63] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:01.853655 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa57588-7e09-43ca-9d28-074055f03d24 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:01.854214 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa57588-7e09-43ca-9d28-074055f03d24 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:01.854725 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa57588-7e09-43ca-9d28-074055f03d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:01.887588 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-faa57588-7e09-43ca-9d28-074055f03d24 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:01.890354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-faa57588-7e09-43ca-9d28-074055f03d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:01.909871 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 34/64] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:13:01.965635 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:01.975627 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 31/65] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:02.225318 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538631cb-098b-4658-902d-9ba8b21204da None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:02.226008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538631cb-098b-4658-902d-9ba8b21204da None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:02.226667 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538631cb-098b-4658-902d-9ba8b21204da None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:02.228261 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 35/66] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:02.234693 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e682629-1abd-4226-9e0a-38a89a9fa348 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:02.235262 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e682629-1abd-4226-9e0a-38a89a9fa348 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:02.235741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e682629-1abd-4226-9e0a-38a89a9fa348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:02.255567 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6914d15-6523-4f16-b6e1-946dbe330afe None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:02.256189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6914d15-6523-4f16-b6e1-946dbe330afe None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:02.256741 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6914d15-6523-4f16-b6e1-946dbe330afe None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:02.258485 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 36/67] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:13:02.265618 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90aaf05-c06e-4eae-91b6-992adab299a4 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:02.266230 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90aaf05-c06e-4eae-91b6-992adab299a4 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:02.266705 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90aaf05-c06e-4eae-91b6-992adab299a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:02.275713 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-6e682629-1abd-4226-9e0a-38a89a9fa348 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:02.278192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-6e682629-1abd-4226-9e0a-38a89a9fa348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:02.297489 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-c90aaf05-c06e-4eae-91b6-992adab299a4 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:02.299006 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-c90aaf05-c06e-4eae-91b6-992adab299a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:02.373428 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:02.384109 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 32/68] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:13:02.413992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e682629-1abd-4226-9e0a-38a89a9fa348 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:02.420442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 37/69] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:02.421404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90aaf05-c06e-4eae-91b6-992adab299a4 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:02.559632 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e682629-1abd-4226-9e0a-38a89a9fa348 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:02.561576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90aaf05-c06e-4eae-91b6-992adab299a4 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:02.594013 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:02.608270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ade05-3809-4d68-98b0-ad8318b80e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:02.608676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c2abd-04d9-47f1-8b8d-8cadddd1af91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:02.608942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ade05-3809-4d68-98b0-ad8318b80e12 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:02.610082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ade05-3809-4d68-98b0-ad8318b80e12 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:02.610082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ade05-3809-4d68-98b0-ad8318b80e12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:02.610263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c2abd-04d9-47f1-8b8d-8cadddd1af91 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:02.610263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c2abd-04d9-47f1-8b8d-8cadddd1af91 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:02.610593 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c2abd-04d9-47f1-8b8d-8cadddd1af91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:02.623337 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ade05-3809-4d68-98b0-ad8318b80e12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:02.624174 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c2abd-04d9-47f1-8b8d-8cadddd1af91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-544ade05-3809-4d68-98b0-ad8318b80e12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:02.628782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:02.629625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:02.630382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:02.630382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:02.630382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:02.630382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:02.630382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:02.630382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:02.630382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:02.630382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:02.630382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:02.630382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:02.630382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:02.630382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-1c0c2abd-04d9-47f1-8b8d-8cadddd1af91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:02.631391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:02.632341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:02.633125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:02.633125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:02.633125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:02.633125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:02.633125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:02.633125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:02.633125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:02.633125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:02.633125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:02.633125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:02.633125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:02.633125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:02.633125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 33/70] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:13:02.635325 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 38/71] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:13:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:02.636603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ade05-3809-4d68-98b0-ad8318b80e12 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:02.637594 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836bdf-7847-41f2-bd82-13ce1d0955cf None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:02.638546 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836bdf-7847-41f2-bd82-13ce1d0955cf None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:02.639153 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e836bdf-7847-41f2-bd82-13ce1d0955cf None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:02.644659 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 34/72] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:02 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:02.646642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e836bdf-7847-41f2-bd82-13ce1d0955cf None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:02.683904 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:02.765339 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ade05-3809-4d68-98b0-ad8318b80e12 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:02.768456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e836bdf-7847-41f2-bd82-13ce1d0955cf None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:02.801639 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f8e8a-f82a-4ffa-918b-ffc10035b821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:02.802249 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8e8a-f82a-4ffa-918b-ffc10035b821 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:02.802531 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8e8a-f82a-4ffa-918b-ffc10035b821 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:02.802808 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f8e8a-f82a-4ffa-918b-ffc10035b821 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:02.803467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f8e8a-f82a-4ffa-918b-ffc10035b821 None admin] RBAC: Adding query filter params (name=member) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:02.803769 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f8e8a-f82a-4ffa-918b-ffc10035b821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:02.804318 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55bbac-56f7-47a6-886f-28ab5aab40d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:02.804971 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55bbac-56f7-47a6-886f-28ab5aab40d2 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:02.805191 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f8e8a-f82a-4ffa-918b-ffc10035b821 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:02.805275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55bbac-56f7-47a6-886f-28ab5aab40d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:02.805523 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55bbac-56f7-47a6-886f-28ab5aab40d2 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:02.806183 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55bbac-56f7-47a6-886f-28ab5aab40d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:02.806499 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55bbac-56f7-47a6-886f-28ab5aab40d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:02.807874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55bbac-56f7-47a6-886f-28ab5aab40d2 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:02.813916 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 39/73] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:02.815195 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c8e66-b1e5-429d-a96a-25e5f4be7771 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:02.815486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c8e66-b1e5-429d-a96a-25e5f4be7771 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:02.815764 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c8e66-b1e5-429d-a96a-25e5f4be7771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:02.819120 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 35/74] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:02.819838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55bbac-56f7-47a6-886f-28ab5aab40d2 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:02.834583 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-804c8e66-b1e5-429d-a96a-25e5f4be7771 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:02.835795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-804c8e66-b1e5-429d-a96a-25e5f4be7771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:02.871046 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:02.905760 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 40/75] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:02.906605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c8e66-b1e5-429d-a96a-25e5f4be7771 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:02.930024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55bbac-56f7-47a6-886f-28ab5aab40d2 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:02.934677 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:02.970378 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70d3b5-d8f1-4960-97dc-842176dc464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:02.971028 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d3b5-d8f1-4960-97dc-842176dc464c None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:02.971367 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d3b5-d8f1-4960-97dc-842176dc464c None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:02.971566 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70d3b5-d8f1-4960-97dc-842176dc464c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:02.982403 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70d3b5-d8f1-4960-97dc-842176dc464c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-cf70d3b5-d8f1-4960-97dc-842176dc464c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:02.987741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:02.988658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:02.989458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:02.989458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:02.989458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:02.989458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:02.989458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:02.989458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:02.989458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:02.989458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:02.989458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:02.989458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:02.989458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:02.989458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:02.989458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 36/76] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:02.990096 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70d3b5-d8f1-4960-97dc-842176dc464c None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:03.016686 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c8e66-b1e5-429d-a96a-25e5f4be7771 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:03.056116 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ac33b-ade7-42ff-9a1e-db0400042e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:03.056785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ac33b-ade7-42ff-9a1e-db0400042e4c None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:03.057067 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ac33b-ade7-42ff-9a1e-db0400042e4c None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:03.057343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ac33b-ade7-42ff-9a1e-db0400042e4c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:03.069087 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ac33b-ade7-42ff-9a1e-db0400042e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-969ac33b-ade7-42ff-9a1e-db0400042e4c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:03.074217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:03.075082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:03.075907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:03.075907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:03.075907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:03.075907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:03.075907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:03.075907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:03.075907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:03.075907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:03.075907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:03.075907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:03.075907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:03.075907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:03.077883 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 41/77] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:13:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:03.083534 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ac33b-ade7-42ff-9a1e-db0400042e4c None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:03.107459 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70d3b5-d8f1-4960-97dc-842176dc464c None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:03.115407 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:03.143507 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76e92e-3358-4753-a1b4-c6ad21d7d4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:03.144190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76e92e-3358-4753-a1b4-c6ad21d7d4cc None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:03.144486 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76e92e-3358-4753-a1b4-c6ad21d7d4cc None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:03.145200 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76e92e-3358-4753-a1b4-c6ad21d7d4cc None admin] PATH_INFO: `/v3/users/56fbb9dd45de404382c3e037536a513e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:03.161707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76e92e-3358-4753-a1b4-c6ad21d7d4cc None admin] RBAC: Authorizing `identity:get_user(user_id=56fbb9dd45de404382c3e037536a513e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:03.163198 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76e92e-3358-4753-a1b4-c6ad21d7d4cc None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:03.165068 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 37/78] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:02 2022] GET /identity/v3/users/56fbb9dd45de404382c3e037536a513e => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:03.165670 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76e92e-3358-4753-a1b4-c6ad21d7d4cc None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:03.193660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:03.220930 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ac33b-ade7-42ff-9a1e-db0400042e4c None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:03.264484 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74e9a7-af3f-4668-87ef-171725f77bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:03.265154 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74e9a7-af3f-4668-87ef-171725f77bf1 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:03.265430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74e9a7-af3f-4668-87ef-171725f77bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:03.265706 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74e9a7-af3f-4668-87ef-171725f77bf1 None admin] PATH_INFO: `/v3/users/3e2bd2fbe30f4ddbb48bb8150f222665` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:03.266883 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74e9a7-af3f-4668-87ef-171725f77bf1 None admin] RBAC: Authorizing `identity:get_user(user_id=3e2bd2fbe30f4ddbb48bb8150f222665)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:03.268359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74e9a7-af3f-4668-87ef-171725f77bf1 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:03.269983 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 42/79] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:03 2022] GET /identity/v3/users/3e2bd2fbe30f4ddbb48bb8150f222665 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:03.270753 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74e9a7-af3f-4668-87ef-171725f77bf1 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:03.273029 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76e92e-3358-4753-a1b4-c6ad21d7d4cc None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:03.311987 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370ab41-45d7-4d59-93e4-132ef9744f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:03.312637 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370ab41-45d7-4d59-93e4-132ef9744f71 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:03.312922 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370ab41-45d7-4d59-93e4-132ef9744f71 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:03.313201 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370ab41-45d7-4d59-93e4-132ef9744f71 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:03.313880 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370ab41-45d7-4d59-93e4-132ef9744f71 None admin] RBAC: Adding query filter params (name=member) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:03.314214 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370ab41-45d7-4d59-93e4-132ef9744f71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:03.315644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370ab41-45d7-4d59-93e4-132ef9744f71 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:03.324805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 38/80] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:03.325465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370ab41-45d7-4d59-93e4-132ef9744f71 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:03.352305 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:03.378868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74e9a7-af3f-4668-87ef-171725f77bf1 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:03.414436 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b521c40-5315-454f-9993-0570d24352f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:03.415038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b521c40-5315-454f-9993-0570d24352f4 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:03.415318 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b521c40-5315-454f-9993-0570d24352f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:03.415589 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b521c40-5315-454f-9993-0570d24352f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:03.416244 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b521c40-5315-454f-9993-0570d24352f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:03.416570 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b521c40-5315-454f-9993-0570d24352f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:03.418013 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b521c40-5315-454f-9993-0570d24352f4 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:03.426725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 43/81] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:13:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:03.427534 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b521c40-5315-454f-9993-0570d24352f4 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:03.432142 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370ab41-45d7-4d59-93e4-132ef9744f71 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:03.445477 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:03.466755 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156194d-6096-468c-abfd-59da6f8c12fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:03.467539 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156194d-6096-468c-abfd-59da6f8c12fa None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:03.467823 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156194d-6096-468c-abfd-59da6f8c12fa None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:03.468096 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156194d-6096-468c-abfd-59da6f8c12fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:03.532842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b521c40-5315-454f-9993-0570d24352f4 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:03.537003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156194d-6096-468c-abfd-59da6f8c12fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:03.538497 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156194d-6096-468c-abfd-59da6f8c12fa None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:03.565116 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:03.567303 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d84a5-4c62-490c-8c20-b89e2b6d096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:03.567939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d84a5-4c62-490c-8c20-b89e2b6d096a None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:03.568223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d84a5-4c62-490c-8c20-b89e2b6d096a None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:03.568506 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d84a5-4c62-490c-8c20-b89e2b6d096a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:03.569650 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d84a5-4c62-490c-8c20-b89e2b6d096a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:03.571090 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d84a5-4c62-490c-8c20-b89e2b6d096a None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:03.572679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 44/82] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:13:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:03.575491 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d84a5-4c62-490c-8c20-b89e2b6d096a None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:03.643369 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 39/83] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:03.644337 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156194d-6096-468c-abfd-59da6f8c12fa None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:03.667191 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:03.684426 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d84a5-4c62-490c-8c20-b89e2b6d096a None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:03.720681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2d712-9af9-4b87-98ec-3dd8d30643e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:03.721311 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2d712-9af9-4b87-98ec-3dd8d30643e0 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:03.721588 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2d712-9af9-4b87-98ec-3dd8d30643e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:03.721862 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2d712-9af9-4b87-98ec-3dd8d30643e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:03.749598 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156194d-6096-468c-abfd-59da6f8c12fa None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:03.775995 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:03.785541 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3018795-3ac9-4541-9c68-2c83e7fe8171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:03.786185 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3018795-3ac9-4541-9c68-2c83e7fe8171 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:03.786468 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3018795-3ac9-4541-9c68-2c83e7fe8171 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:03.786738 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3018795-3ac9-4541-9c68-2c83e7fe8171 None admin] PATH_INFO: `/v3/users/56fbb9dd45de404382c3e037536a513e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:03.787880 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3018795-3ac9-4541-9c68-2c83e7fe8171 None admin] RBAC: Authorizing `identity:get_user(user_id=56fbb9dd45de404382c3e037536a513e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:03.789404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3018795-3ac9-4541-9c68-2c83e7fe8171 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:03.791044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 40/84] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:03 2022] GET /identity/v3/users/56fbb9dd45de404382c3e037536a513e => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:03.803730 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3018795-3ac9-4541-9c68-2c83e7fe8171 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:03.804013 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2d712-9af9-4b87-98ec-3dd8d30643e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:03.804013 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2d712-9af9-4b87-98ec-3dd8d30643e0 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:03.886187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:03.902417 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3018795-3ac9-4541-9c68-2c83e7fe8171 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:03.905349 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 45/85] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:03.905349 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2d712-9af9-4b87-98ec-3dd8d30643e0 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:03.942478 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c0b38-e002-43a9-a57b-4e05caf8b143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:03.943120 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0b38-e002-43a9-a57b-4e05caf8b143 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:03.943403 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0b38-e002-43a9-a57b-4e05caf8b143 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:03.943684 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0b38-e002-43a9-a57b-4e05caf8b143 None admin] PATH_INFO: `/v3/users/56fbb9dd45de404382c3e037536a513e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:03.944862 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c0b38-e002-43a9-a57b-4e05caf8b143 None admin] RBAC: Authorizing `identity:get_user(user_id=56fbb9dd45de404382c3e037536a513e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:03.946350 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c0b38-e002-43a9-a57b-4e05caf8b143 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:03.947949 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 41/86] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:03 2022] GET /identity/v3/users/56fbb9dd45de404382c3e037536a513e => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:03.953614 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c0b38-e002-43a9-a57b-4e05caf8b143 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:04.019155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2d712-9af9-4b87-98ec-3dd8d30643e0 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:04.019780 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:04.055115 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d0080-d191-499f-8f5c-c73bb07ab80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:04.055724 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0080-d191-499f-8f5c-c73bb07ab80f None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:04.056345 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0080-d191-499f-8f5c-c73bb07ab80f None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:04.056345 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d0080-d191-499f-8f5c-c73bb07ab80f None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:04.056944 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d0080-d191-499f-8f5c-c73bb07ab80f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:04.058407 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d0080-d191-499f-8f5c-c73bb07ab80f None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:04.061306 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c0b38-e002-43a9-a57b-4e05caf8b143 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:04.100936 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810c735-ab66-44f6-b1da-e95cac2682d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:04.101586 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810c735-ab66-44f6-b1da-e95cac2682d6 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:04.101869 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810c735-ab66-44f6-b1da-e95cac2682d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:04.102147 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810c735-ab66-44f6-b1da-e95cac2682d6 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:04.103294 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810c735-ab66-44f6-b1da-e95cac2682d6 None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:04.104819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810c735-ab66-44f6-b1da-e95cac2682d6 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:04.106500 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 42/87] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:03 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:04.107343 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810c735-ab66-44f6-b1da-e95cac2682d6 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:04.117449 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 46/88] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Sep 3 21:13:03 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:13:04.118169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d0080-d191-499f-8f5c-c73bb07ab80f None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:04.177211 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:04.245940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810c735-ab66-44f6-b1da-e95cac2682d6 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:04.246541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d0080-d191-499f-8f5c-c73bb07ab80f None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:04.284553 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:04.289150 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672c2c5-d5d7-4246-b052-1373f3916fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:04.289814 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c2c5-d5d7-4246-b052-1373f3916fce None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:04.290102 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c2c5-d5d7-4246-b052-1373f3916fce None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:04.290382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672c2c5-d5d7-4246-b052-1373f3916fce None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:04.291259 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7688ddc-1709-48b8-9734-5a89c8f7cbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:04.291557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672c2c5-d5d7-4246-b052-1373f3916fce None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:04.291894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688ddc-1709-48b8-9734-5a89c8f7cbc7 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:04.292183 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688ddc-1709-48b8-9734-5a89c8f7cbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:04.292464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7688ddc-1709-48b8-9734-5a89c8f7cbc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:04.293102 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8672c2c5-d5d7-4246-b052-1373f3916fce None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:04.295719 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 47/89] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:04 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:04.296374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672c2c5-d5d7-4246-b052-1373f3916fce None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:04.403451 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7688ddc-1709-48b8-9734-5a89c8f7cbc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:04.406383 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7688ddc-1709-48b8-9734-5a89c8f7cbc7 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:04.438236 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672c2c5-d5d7-4246-b052-1373f3916fce None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:04.461076 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:04.491908 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393c20a-248a-4636-8e7e-b64ea27384e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:04.492901 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c20a-248a-4636-8e7e-b64ea27384e8 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:04.493193 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c20a-248a-4636-8e7e-b64ea27384e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:04.493479 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c20a-248a-4636-8e7e-b64ea27384e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:04.545134 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 43/90] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:04.546490 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7688ddc-1709-48b8-9734-5a89c8f7cbc7 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:04.581859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:04.582748 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393c20a-248a-4636-8e7e-b64ea27384e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:04.584495 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393c20a-248a-4636-8e7e-b64ea27384e8 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:04.662227 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7688ddc-1709-48b8-9734-5a89c8f7cbc7 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:04.701924 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 48/91] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:04.702128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff2ea2-0794-48ac-8c46-895e7369f135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:04.702650 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393c20a-248a-4636-8e7e-b64ea27384e8 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:04.702756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff2ea2-0794-48ac-8c46-895e7369f135 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:04.703034 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff2ea2-0794-48ac-8c46-895e7369f135 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:04.703308 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff2ea2-0794-48ac-8c46-895e7369f135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:04.704150 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff2ea2-0794-48ac-8c46-895e7369f135 None admin] RBAC: Adding query filter params (role.id=b7001437cbb84adc825e214c44d6e551, scope.project.id=b54c43bcbc404d39884c37ef65b10c56, user.id=56fbb9dd45de404382c3e037536a513e) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:04.704415 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff2ea2-0794-48ac-8c46-895e7369f135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:04.706210 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff2ea2-0794-48ac-8c46-895e7369f135 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:04.712844 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 44/92] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:04 2022] GET /identity/v3/role_assignments?user.id=56fbb9dd45de404382c3e037536a513e&scope.project.id=b54c43bcbc404d39884c37ef65b10c56&role.id=b7001437cbb84adc825e214c44d6e551 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:04.713758 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff2ea2-0794-48ac-8c46-895e7369f135 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:04.714107 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:04.871901 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393c20a-248a-4636-8e7e-b64ea27384e8 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:04.918750 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222ed3e-cc35-4173-8bd4-da7e70eb321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:04.920316 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ed3e-cc35-4173-8bd4-da7e70eb321d None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:04.920769 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ed3e-cc35-4173-8bd4-da7e70eb321d None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:04.921131 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222ed3e-cc35-4173-8bd4-da7e70eb321d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:04.922045 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222ed3e-cc35-4173-8bd4-da7e70eb321d None admin] RBAC: Adding query filter params (role.id=a1c22a1558c34c1d9d262bf1da31887e, scope.project.id=b54c43bcbc404d39884c37ef65b10c56, user.id=3e2bd2fbe30f4ddbb48bb8150f222665) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:04.922444 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222ed3e-cc35-4173-8bd4-da7e70eb321d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:04.924252 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222ed3e-cc35-4173-8bd4-da7e70eb321d None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:04.934514 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 49/93] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:04 2022] GET /identity/v3/role_assignments?user.id=3e2bd2fbe30f4ddbb48bb8150f222665&scope.project.id=b54c43bcbc404d39884c37ef65b10c56&role.id=a1c22a1558c34c1d9d262bf1da31887e => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:04.935578 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222ed3e-cc35-4173-8bd4-da7e70eb321d None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:04.961142 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:04.980128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff2ea2-0794-48ac-8c46-895e7369f135 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:05.032461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:05.085028 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459b44a-d1d3-4534-9782-7ba5bd8f3da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:05.085694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459b44a-d1d3-4534-9782-7ba5bd8f3da9 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:05.085981 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459b44a-d1d3-4534-9782-7ba5bd8f3da9 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:05.086265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459b44a-d1d3-4534-9782-7ba5bd8f3da9 None admin] PATH_INFO: `/v3/projects/2ff11f587a5849f3938f1424a0d2a084` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:05.089241 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222ed3e-cc35-4173-8bd4-da7e70eb321d None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:05.091986 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459b44a-d1d3-4534-9782-7ba5bd8f3da9 None admin] RBAC: Authorizing `identity:get_project(project_id=2ff11f587a5849f3938f1424a0d2a084)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:05.093682 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459b44a-d1d3-4534-9782-7ba5bd8f3da9 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:05.095533 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 45/94] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:04 2022] GET /identity/v3/projects/2ff11f587a5849f3938f1424a0d2a084 => generated 312 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:05.103541 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459b44a-d1d3-4534-9782-7ba5bd8f3da9 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:05.171508 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa445ed1-737c-40b0-8a90-2cec33b274df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:05.172162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa445ed1-737c-40b0-8a90-2cec33b274df None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:05.172447 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa445ed1-737c-40b0-8a90-2cec33b274df None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:05.172750 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa445ed1-737c-40b0-8a90-2cec33b274df None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:05.174584 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa445ed1-737c-40b0-8a90-2cec33b274df None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:05.176236 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa445ed1-737c-40b0-8a90-2cec33b274df None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:05.180050 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 50/95] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:04 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:05.184723 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa445ed1-737c-40b0-8a90-2cec33b274df None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:05.349905 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459b44a-d1d3-4534-9782-7ba5bd8f3da9 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:05.350929 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa445ed1-737c-40b0-8a90-2cec33b274df None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:05.414809 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c28fbc-dbe7-474a-bf39-5a3e7b8600b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:05.415439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c28fbc-dbe7-474a-bf39-5a3e7b8600b9 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:05.415778 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c28fbc-dbe7-474a-bf39-5a3e7b8600b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:05.416063 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c28fbc-dbe7-474a-bf39-5a3e7b8600b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:05.416823 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c28fbc-dbe7-474a-bf39-5a3e7b8600b9 None admin] RBAC: Adding query filter params (role.id=753aa4902b7544299c8bed1f59c1153e, scope.project.id=b54c43bcbc404d39884c37ef65b10c56, user.id=56fbb9dd45de404382c3e037536a513e) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:05.417203 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c28fbc-dbe7-474a-bf39-5a3e7b8600b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:05.418672 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c28fbc-dbe7-474a-bf39-5a3e7b8600b9 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:05.425016 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 51/96] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:05 2022] GET /identity/v3/role_assignments?user.id=56fbb9dd45de404382c3e037536a513e&scope.project.id=b54c43bcbc404d39884c37ef65b10c56&role.id=753aa4902b7544299c8bed1f59c1153e => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:05.452336 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad018f-545e-4e92-8bec-703f06511ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:05.452998 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad018f-545e-4e92-8bec-703f06511ed1 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:05.453281 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad018f-545e-4e92-8bec-703f06511ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:05.453553 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad018f-545e-4e92-8bec-703f06511ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:05.454295 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad018f-545e-4e92-8bec-703f06511ed1 None admin] RBAC: Adding query filter params (role.id=b7001437cbb84adc825e214c44d6e551, scope.project.id=2ff11f587a5849f3938f1424a0d2a084, user.id=56fbb9dd45de404382c3e037536a513e) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:05.454607 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad018f-545e-4e92-8bec-703f06511ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:05.456159 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad018f-545e-4e92-8bec-703f06511ed1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:05.465395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 46/97] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:05 2022] GET /identity/v3/role_assignments?user.id=56fbb9dd45de404382c3e037536a513e&scope.project.id=2ff11f587a5849f3938f1424a0d2a084&role.id=b7001437cbb84adc825e214c44d6e551 => generated 259 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:06.840101 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290a908-44db-47fc-84a8-523951ac5850 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:06.840648 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290a908-44db-47fc-84a8-523951ac5850 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:06.840723 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290a908-44db-47fc-84a8-523951ac5850 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:06.843818 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 52/98] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:06.849959 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadfc3d-2a9c-46c1-9c10-2d6e7d2964f9 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:06.850473 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadfc3d-2a9c-46c1-9c10-2d6e7d2964f9 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:06.850545 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadfc3d-2a9c-46c1-9c10-2d6e7d2964f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:06.875057 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-ccadfc3d-2a9c-46c1-9c10-2d6e7d2964f9 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:06.876284 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-ccadfc3d-2a9c-46c1-9c10-2d6e7d2964f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:06.909922 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:06.985886 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 47/99] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:07.498980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a3f6-7b36-439d-8114-faa7b4dcea5c None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:07.499616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a3f6-7b36-439d-8114-faa7b4dcea5c None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:07.499896 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a3f6-7b36-439d-8114-faa7b4dcea5c None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:07.502281 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 53/100] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:07.509023 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd068fed-e366-49f7-9e3a-35eb52b54425 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:07.509500 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd068fed-e366-49f7-9e3a-35eb52b54425 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:07.509984 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd068fed-e366-49f7-9e3a-35eb52b54425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:07.559961 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-dd068fed-e366-49f7-9e3a-35eb52b54425 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:07.567039 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-dd068fed-e366-49f7-9e3a-35eb52b54425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:07.662165 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 48/101] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:07.739278 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70a3f6-7b36-439d-8114-faa7b4dcea5c None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:07.748235 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:07.942335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70a3f6-7b36-439d-8114-faa7b4dcea5c None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:07.992499 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f27e7d-71ee-4698-aefc-85b490bb37b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:07.993229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f27e7d-71ee-4698-aefc-85b490bb37b5 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:07.993522 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f27e7d-71ee-4698-aefc-85b490bb37b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:07.993801 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f27e7d-71ee-4698-aefc-85b490bb37b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:07.995006 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f27e7d-71ee-4698-aefc-85b490bb37b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:07.996507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f27e7d-71ee-4698-aefc-85b490bb37b5 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:07.998621 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 54/102] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:13:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:08.004615 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd068fed-e366-49f7-9e3a-35eb52b54425 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:08.026339 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d273e42-eaf9-4f5a-85f1-2ea968c448d5 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:08.026727 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d273e42-eaf9-4f5a-85f1-2ea968c448d5 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:08.026918 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d273e42-eaf9-4f5a-85f1-2ea968c448d5 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:08.029063 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 55/103] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:08.035157 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8c1ce-287a-4481-a72c-86ba46d2a390 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:08.035726 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8c1ce-287a-4481-a72c-86ba46d2a390 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:08.036168 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8c1ce-287a-4481-a72c-86ba46d2a390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:08.074441 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-17e8c1ce-287a-4481-a72c-86ba46d2a390 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:08.077430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-17e8c1ce-287a-4481-a72c-86ba46d2a390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:08.160590 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:08.194327 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd068fed-e366-49f7-9e3a-35eb52b54425 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:08.239251 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 56/104] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:13:08.240411 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8c1ce-287a-4481-a72c-86ba46d2a390 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:08.243216 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:08.286286 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781508d8-4c1b-4dfc-b253-4d4457825fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:08.286917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781508d8-4c1b-4dfc-b253-4d4457825fee None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:08.287197 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781508d8-4c1b-4dfc-b253-4d4457825fee None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:08.287470 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781508d8-4c1b-4dfc-b253-4d4457825fee None admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:08.288550 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781508d8-4c1b-4dfc-b253-4d4457825fee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:08.289607 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781508d8-4c1b-4dfc-b253-4d4457825fee None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:08.365625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8c1ce-287a-4481-a72c-86ba46d2a390 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:08.408617 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 49/105] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Sep 3 21:13:08 2022] POST /identity/v3/projects => generated 302 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:13:08.427561 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd0461-b3fb-42a2-bb6e-4302c65e0c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:08.428709 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd0461-b3fb-42a2-bb6e-4302c65e0c00 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:08.435751 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd0461-b3fb-42a2-bb6e-4302c65e0c00 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:08.435751 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd0461-b3fb-42a2-bb6e-4302c65e0c00 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:08.444658 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd0461-b3fb-42a2-bb6e-4302c65e0c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-7ebd0461-b3fb-42a2-bb6e-4302c65e0c00 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:08.450182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:08.451884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:08.453175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:08.453175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:08.453175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:08.453175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:08.453175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:08.453175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:08.453175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:08.453175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:08.453175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:08.453175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:08.453175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:08.453175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:08.455399 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 57/106] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:08.465083 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781508d8-4c1b-4dfc-b253-4d4457825fee None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:08.609130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781508d8-4c1b-4dfc-b253-4d4457825fee None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:08.660109 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e385ac-8f61-4c6c-ab15-ac72d777fce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:08.661017 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e385ac-8f61-4c6c-ab15-ac72d777fce1 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:08.661462 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e385ac-8f61-4c6c-ab15-ac72d777fce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:08.661889 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e385ac-8f61-4c6c-ab15-ac72d777fce1 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:08.662772 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e385ac-8f61-4c6c-ab15-ac72d777fce1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:08.663272 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e385ac-8f61-4c6c-ab15-ac72d777fce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:08.664857 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e385ac-8f61-4c6c-ab15-ac72d777fce1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:08.676225 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:08.681097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 50/107] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:08.687153 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd0461-b3fb-42a2-bb6e-4302c65e0c00 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:08.776166 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:08.792118 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52283b0-ad97-46ef-80b2-f48d82e2b54c None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:08.792443 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52283b0-ad97-46ef-80b2-f48d82e2b54c None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:08.792733 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52283b0-ad97-46ef-80b2-f48d82e2b54c None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:08.794694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 51/108] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:08.806579 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f669d22-9743-4674-9038-d8665951b11a None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:08.806921 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f669d22-9743-4674-9038-d8665951b11a None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:08.807136 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f669d22-9743-4674-9038-d8665951b11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:08.825824 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd0461-b3fb-42a2-bb6e-4302c65e0c00 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:08.845980 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-1f669d22-9743-4674-9038-d8665951b11a None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:08.847225 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-1f669d22-9743-4674-9038-d8665951b11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:08.894861 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eb752-6a1b-4006-99d3-18f1f31f9a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:08.895568 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eb752-6a1b-4006-99d3-18f1f31f9a10 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:08.895857 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eb752-6a1b-4006-99d3-18f1f31f9a10 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:08.896136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eb752-6a1b-4006-99d3-18f1f31f9a10 None admin] PATH_INFO: `/v3/users/52beb353a5f0479da28ac6e5cef06318` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:08.928851 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1eb752-6a1b-4006-99d3-18f1f31f9a10 None admin] RBAC: Authorizing `identity:get_user(user_id=52beb353a5f0479da28ac6e5cef06318)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:08.930626 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1eb752-6a1b-4006-99d3-18f1f31f9a10 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:08.932752 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 58/109] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:08 2022] GET /identity/v3/users/52beb353a5f0479da28ac6e5cef06318 => generated 289 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:08.933694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eb752-6a1b-4006-99d3-18f1f31f9a10 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:08.954050 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 52/110] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:13:08.955561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f669d22-9743-4674-9038-d8665951b11a None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:09.126533 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eb752-6a1b-4006-99d3-18f1f31f9a10 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:09.166091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:09.169972 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f669d22-9743-4674-9038-d8665951b11a None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:09.182482 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233a421-b0de-4726-888c-8e1c2be1220d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:09.183538 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233a421-b0de-4726-888c-8e1c2be1220d None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:09.184016 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233a421-b0de-4726-888c-8e1c2be1220d None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:09.184590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233a421-b0de-4726-888c-8e1c2be1220d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:09.195782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233a421-b0de-4726-888c-8e1c2be1220d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-e233a421-b0de-4726-888c-8e1c2be1220d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:09.202590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:09.203461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:09.204238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:09.204238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:09.204238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:09.204238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:09.204238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:09.204238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:09.204238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:09.204238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:09.204238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:09.204238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:09.204238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:09.204238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:09.205994 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:09.207908 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 59/111] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:09.209974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23845-5608-4fee-bd68-efdd766bfa4c None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:09.210490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23845-5608-4fee-bd68-efdd766bfa4c None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:09.211006 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23845-5608-4fee-bd68-efdd766bfa4c None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:09.211778 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555d703-1cb5-4c6d-a028-55812f6eae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:09.212395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555d703-1cb5-4c6d-a028-55812f6eae2e None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:09.212712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555d703-1cb5-4c6d-a028-55812f6eae2e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:09.212990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555d703-1cb5-4c6d-a028-55812f6eae2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:09.213559 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 60/112] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:09.214466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f23845-5608-4fee-bd68-efdd766bfa4c None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:09.311980 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555d703-1cb5-4c6d-a028-55812f6eae2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:09.314342 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555d703-1cb5-4c6d-a028-55812f6eae2e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:09.342793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f23845-5608-4fee-bd68-efdd766bfa4c None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:09.386644 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19cf83-9ed6-4aec-9655-73f558d2f5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:09.387261 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19cf83-9ed6-4aec-9655-73f558d2f5d8 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:09.387536 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19cf83-9ed6-4aec-9655-73f558d2f5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:09.387880 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19cf83-9ed6-4aec-9655-73f558d2f5d8 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:09.388555 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19cf83-9ed6-4aec-9655-73f558d2f5d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:09.388962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19cf83-9ed6-4aec-9655-73f558d2f5d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:09.390686 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19cf83-9ed6-4aec-9655-73f558d2f5d8 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:09.402974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 61/113] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:09.405556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d778b42-0ce5-4167-98f2-73e60be0b033 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:09.406075 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d778b42-0ce5-4167-98f2-73e60be0b033 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:09.406572 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d778b42-0ce5-4167-98f2-73e60be0b033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:09.430899 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-9d778b42-0ce5-4167-98f2-73e60be0b033 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:09.433185 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-9d778b42-0ce5-4167-98f2-73e60be0b033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:09.456777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 53/114] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:09.457472 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555d703-1cb5-4c6d-a028-55812f6eae2e None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:09.490571 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:09.498987 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:09.531033 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 62/115] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:09.540927 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d778b42-0ce5-4167-98f2-73e60be0b033 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:09.585748 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555d703-1cb5-4c6d-a028-55812f6eae2e None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:09.625573 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90932ee-6f8e-44fe-bbdd-878adb862664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:09.626210 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90932ee-6f8e-44fe-bbdd-878adb862664 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:09.626490 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90932ee-6f8e-44fe-bbdd-878adb862664 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:09.626759 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90932ee-6f8e-44fe-bbdd-878adb862664 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:09.641266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90932ee-6f8e-44fe-bbdd-878adb862664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-b90932ee-6f8e-44fe-bbdd-878adb862664 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:09.648357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:09.649254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:09.650016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:09.650016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:09.650016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:09.650016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:09.650016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:09.650016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:09.650016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:09.650016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:09.650016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:09.650016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:09.650016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:09.650016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:09.650016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 54/116] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:13:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:09.651087 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90932ee-6f8e-44fe-bbdd-878adb862664 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:09.670353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d778b42-0ce5-4167-98f2-73e60be0b033 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:09.714247 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d092247-cd57-4648-904b-9faa4c88bd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:09.715052 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d092247-cd57-4648-904b-9faa4c88bd59 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:09.715430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d092247-cd57-4648-904b-9faa4c88bd59 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:09.716074 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d092247-cd57-4648-904b-9faa4c88bd59 None admin] PATH_INFO: `/v3/users/56fbb9dd45de404382c3e037536a513e` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:09.717379 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d092247-cd57-4648-904b-9faa4c88bd59 None admin] RBAC: Authorizing `identity:get_user(user_id=56fbb9dd45de404382c3e037536a513e)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:09.718948 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d092247-cd57-4648-904b-9faa4c88bd59 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:09.720979 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 63/117] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:09 2022] GET /identity/v3/users/56fbb9dd45de404382c3e037536a513e => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:09.722234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90440-a38a-474f-b888-015fdfc5c5d2 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:09.722615 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90440-a38a-474f-b888-015fdfc5c5d2 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:09.722988 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f90440-a38a-474f-b888-015fdfc5c5d2 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:09.724485 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 64/118] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:09.725126 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f90440-a38a-474f-b888-015fdfc5c5d2 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:09.777757 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:09.786569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:09.800062 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90932ee-6f8e-44fe-bbdd-878adb862664 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:09.845774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7907b35-5873-4781-b315-9f2f5ebde124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:09.846338 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f90440-a38a-474f-b888-015fdfc5c5d2 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:09.846917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7907b35-5873-4781-b315-9f2f5ebde124 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:09.847359 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7907b35-5873-4781-b315-9f2f5ebde124 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:09.847878 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7907b35-5873-4781-b315-9f2f5ebde124 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:09.850422 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7907b35-5873-4781-b315-9f2f5ebde124 None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:09.852137 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7907b35-5873-4781-b315-9f2f5ebde124 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:09.854402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 55/119] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:09 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:09.855422 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7907b35-5873-4781-b315-9f2f5ebde124 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:09.889880 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b3b504-d1b1-47a2-9b60-2e18759fa42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:09.890943 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3b504-d1b1-47a2-9b60-2e18759fa42e None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:09.891226 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3b504-d1b1-47a2-9b60-2e18759fa42e None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:09.891812 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b3b504-d1b1-47a2-9b60-2e18759fa42e None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:09.892427 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3b504-d1b1-47a2-9b60-2e18759fa42e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:09.893013 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3b504-d1b1-47a2-9b60-2e18759fa42e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:09.895104 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b3b504-d1b1-47a2-9b60-2e18759fa42e None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:09.906532 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 65/120] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:09.908205 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e832921-471b-4a27-8ad0-b6ee394e4761 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:09.908562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e832921-471b-4a27-8ad0-b6ee394e4761 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:09.909200 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e832921-471b-4a27-8ad0-b6ee394e4761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:09.933471 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-7e832921-471b-4a27-8ad0-b6ee394e4761 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:09.935671 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-7e832921-471b-4a27-8ad0-b6ee394e4761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:09.979105 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7907b35-5873-4781-b315-9f2f5ebde124 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:10.008590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 66/121] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:10.016765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e832921-471b-4a27-8ad0-b6ee394e4761 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:10.032510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae729402-f8f5-4f54-bcce-84634940dffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:10.033188 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae729402-f8f5-4f54-bcce-84634940dffa None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:10.033473 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae729402-f8f5-4f54-bcce-84634940dffa None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:10.033753 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae729402-f8f5-4f54-bcce-84634940dffa None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:10.035375 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae729402-f8f5-4f54-bcce-84634940dffa None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:10.037263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae729402-f8f5-4f54-bcce-84634940dffa None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:10.039690 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 56/122] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:09 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:10.040647 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae729402-f8f5-4f54-bcce-84634940dffa None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:10.045660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:10.081605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:10.137566 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e832921-471b-4a27-8ad0-b6ee394e4761 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:10.167386 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae729402-f8f5-4f54-bcce-84634940dffa None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:10.177761 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58709c4d-9d27-4702-a6bd-97ad7c49bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:10.178741 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58709c4d-9d27-4702-a6bd-97ad7c49bd2f None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:10.179036 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58709c4d-9d27-4702-a6bd-97ad7c49bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:10.179315 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58709c4d-9d27-4702-a6bd-97ad7c49bd2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:10.180051 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58709c4d-9d27-4702-a6bd-97ad7c49bd2f None admin] RBAC: Adding query filter params (role.id=46aa5e1d5e704ae78369f7707f6977dc, scope.project.id=b54c43bcbc404d39884c37ef65b10c56, user.id=52beb353a5f0479da28ac6e5cef06318) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:10.180362 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58709c4d-9d27-4702-a6bd-97ad7c49bd2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:10.181958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58709c4d-9d27-4702-a6bd-97ad7c49bd2f None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:10.188857 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 67/123] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:10 2022] GET /identity/v3/role_assignments?user.id=52beb353a5f0479da28ac6e5cef06318&scope.project.id=b54c43bcbc404d39884c37ef65b10c56&role.id=46aa5e1d5e704ae78369f7707f6977dc => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:10.189954 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58709c4d-9d27-4702-a6bd-97ad7c49bd2f None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:10.252854 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d979c8d-5cdd-4863-8c0c-19a7c7c5935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:10.253618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d979c8d-5cdd-4863-8c0c-19a7c7c5935d None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:10.253808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d979c8d-5cdd-4863-8c0c-19a7c7c5935d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:10.254659 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d979c8d-5cdd-4863-8c0c-19a7c7c5935d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:10.280239 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d979c8d-5cdd-4863-8c0c-19a7c7c5935d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-0d979c8d-5cdd-4863-8c0c-19a7c7c5935d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:10.288465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:10.289428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:10.290190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:10.290190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:10.290190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:10.290190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:10.290190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:10.290190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:10.290190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:10.290190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:10.290190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:10.290190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:10.290190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:10.290190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:10.290190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 57/124] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:13:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:10.295626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d979c8d-5cdd-4863-8c0c-19a7c7c5935d None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:10.369631 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58709c4d-9d27-4702-a6bd-97ad7c49bd2f None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:10.380957 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:10.419963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa651871-79bc-4e44-96df-03066f203103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:10.422605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa651871-79bc-4e44-96df-03066f203103 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:10.422894 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa651871-79bc-4e44-96df-03066f203103 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:10.423173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa651871-79bc-4e44-96df-03066f203103 None admin] PATH_INFO: `/v3/users/3e2bd2fbe30f4ddbb48bb8150f222665` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:10.425385 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa651871-79bc-4e44-96df-03066f203103 None admin] RBAC: Authorizing `identity:get_user(user_id=3e2bd2fbe30f4ddbb48bb8150f222665)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:10.426589 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa651871-79bc-4e44-96df-03066f203103 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:10.428361 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 68/125] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:10 2022] GET /identity/v3/users/3e2bd2fbe30f4ddbb48bb8150f222665 => generated 247 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:10.429847 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa651871-79bc-4e44-96df-03066f203103 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:10.459120 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:10.477665 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d979c8d-5cdd-4863-8c0c-19a7c7c5935d None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:10.519020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334e92d-5d90-4e46-8925-0d82758af60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:10.520078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334e92d-5d90-4e46-8925-0d82758af60c None admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:10.520592 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334e92d-5d90-4e46-8925-0d82758af60c None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:10.521110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334e92d-5d90-4e46-8925-0d82758af60c None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56/users/56fbb9dd45de404382c3e037536a513e/roles/b7001437cbb84adc825e214c44d6e551` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:10.523689 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334e92d-5d90-4e46-8925-0d82758af60c None admin] RBAC: Authorizing `identity:create_grant(project_id=b54c43bcbc404d39884c37ef65b10c56, user_id=56fbb9dd45de404382c3e037536a513e, role_id=b7001437cbb84adc825e214c44d6e551)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:10.525527 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334e92d-5d90-4e46-8925-0d82758af60c None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:10.549556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa651871-79bc-4e44-96df-03066f203103 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:10.587259 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fd09b-12e2-484d-a5e1-d9efc0790526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:10.587868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fd09b-12e2-484d-a5e1-d9efc0790526 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:10.588149 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fd09b-12e2-484d-a5e1-d9efc0790526 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:10.588423 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fd09b-12e2-484d-a5e1-d9efc0790526 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:10.595601 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fd09b-12e2-484d-a5e1-d9efc0790526 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:10.595601 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fd09b-12e2-484d-a5e1-d9efc0790526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:10.595601 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fd09b-12e2-484d-a5e1-d9efc0790526 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:10.600458 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 69/126] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:13:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:10.601148 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fd09b-12e2-484d-a5e1-d9efc0790526 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:10.620042 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 58/127] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:13:10 2022] PUT /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56/users/56fbb9dd45de404382c3e037536a513e/roles/b7001437cbb84adc825e214c44d6e551 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:13:10.620900 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334e92d-5d90-4e46-8925-0d82758af60c None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:10.654331 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:10.757237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334e92d-5d90-4e46-8925-0d82758af60c None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:10.764403 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fd09b-12e2-484d-a5e1-d9efc0790526 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:10.807009 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f8e74-1d7d-4c07-bcd3-2b06f603b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:10.807923 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f8e74-1d7d-4c07-bcd3-2b06f603b010 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:10.808039 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b82417-416b-4646-8b10-e674488f110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:10.808279 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f8e74-1d7d-4c07-bcd3-2b06f603b010 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:10.808634 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b82417-416b-4646-8b10-e674488f110e None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:10.808755 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f8e74-1d7d-4c07-bcd3-2b06f603b010 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:10.808924 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b82417-416b-4646-8b10-e674488f110e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:10.809206 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b82417-416b-4646-8b10-e674488f110e None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:10.811283 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b82417-416b-4646-8b10-e674488f110e None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:10.813283 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b82417-416b-4646-8b10-e674488f110e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:10.815378 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 59/128] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:10 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:10.816227 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b82417-416b-4646-8b10-e674488f110e None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:10.834681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f8e74-1d7d-4c07-bcd3-2b06f603b010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:10.841936 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-358f8e74-1d7d-4c07-bcd3-2b06f603b010 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:10.843507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:10.844490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:10.846169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:10.846169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:10.846169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:10.846169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:10.846169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:10.846169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:10.846169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:10.846169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:10.846169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:10.846169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:10.846169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:10.846169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:10.846169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 70/129] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:10.846169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f8e74-1d7d-4c07-bcd3-2b06f603b010 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:10.966563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:10.972796 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b82417-416b-4646-8b10-e674488f110e None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:10.985802 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f8e74-1d7d-4c07-bcd3-2b06f603b010 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:11.027679 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e2a73-1515-4c47-a674-bcbe55b77535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:11.029530 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e2a73-1515-4c47-a674-bcbe55b77535 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:11.030024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e2a73-1515-4c47-a674-bcbe55b77535 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:11.030691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e2a73-1515-4c47-a674-bcbe55b77535 None admin] PATH_INFO: `/v3/users/56fbb9dd45de404382c3e037536a513e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:11.032724 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e2a73-1515-4c47-a674-bcbe55b77535 None admin] RBAC: Authorizing `identity:get_user(user_id=56fbb9dd45de404382c3e037536a513e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:11.034577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e2a73-1515-4c47-a674-bcbe55b77535 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:11.036453 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 60/130] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:10 2022] GET /identity/v3/users/56fbb9dd45de404382c3e037536a513e => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:11.037497 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e2a73-1515-4c47-a674-bcbe55b77535 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:11.038865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb6118-4ce3-4569-96bd-6a6f805fc9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:11.039812 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb6118-4ce3-4569-96bd-6a6f805fc9e4 None admin] REQUEST_METHOD: `PUT` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:11.040332 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb6118-4ce3-4569-96bd-6a6f805fc9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:11.041256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb6118-4ce3-4569-96bd-6a6f805fc9e4 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56/users/3e2bd2fbe30f4ddbb48bb8150f222665/roles/a1c22a1558c34c1d9d262bf1da31887e` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:11.045416 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb6118-4ce3-4569-96bd-6a6f805fc9e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b54c43bcbc404d39884c37ef65b10c56, user_id=3e2bd2fbe30f4ddbb48bb8150f222665, role_id=a1c22a1558c34c1d9d262bf1da31887e)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:11.047147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb6118-4ce3-4569-96bd-6a6f805fc9e4 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:11.145708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:11.161027 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 71/131] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:13:10 2022] PUT /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56/users/3e2bd2fbe30f4ddbb48bb8150f222665/roles/a1c22a1558c34c1d9d262bf1da31887e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:13:11.162065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb6118-4ce3-4569-96bd-6a6f805fc9e4 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:11.168109 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e2a73-1515-4c47-a674-bcbe55b77535 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:11.208080 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa57903-92b9-4dd6-bde6-2adedfe5490e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:11.209124 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa57903-92b9-4dd6-bde6-2adedfe5490e None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:11.209587 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa57903-92b9-4dd6-bde6-2adedfe5490e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:11.210130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa57903-92b9-4dd6-bde6-2adedfe5490e None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:11.210986 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa57903-92b9-4dd6-bde6-2adedfe5490e None admin] RBAC: Adding query filter params (name=member) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:11.211497 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa57903-92b9-4dd6-bde6-2adedfe5490e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:11.213528 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa57903-92b9-4dd6-bde6-2adedfe5490e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:11.224517 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 61/132] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:11.241651 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa57903-92b9-4dd6-bde6-2adedfe5490e None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:11.472030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb6118-4ce3-4569-96bd-6a6f805fc9e4 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:11.484111 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa57903-92b9-4dd6-bde6-2adedfe5490e None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:11.517203 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6b8e3-4723-4706-af80-c7b9ff7d67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:11.517860 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6b8e3-4723-4706-af80-c7b9ff7d67d5 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:11.518148 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6b8e3-4723-4706-af80-c7b9ff7d67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:11.518428 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6b8e3-4723-4706-af80-c7b9ff7d67d5 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:11.519625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6b8e3-4723-4706-af80-c7b9ff7d67d5 None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:11.521296 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6b8e3-4723-4706-af80-c7b9ff7d67d5 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:11.523519 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 72/133] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:11 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:11.534358 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6b8e3-4723-4706-af80-c7b9ff7d67d5 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:11.563276 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2894eb1-6867-4cd7-988e-233d48ebd471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:11.563927 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2894eb1-6867-4cd7-988e-233d48ebd471 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:11.564214 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2894eb1-6867-4cd7-988e-233d48ebd471 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:11.564490 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2894eb1-6867-4cd7-988e-233d48ebd471 None admin] PATH_INFO: `/v3/users/56fbb9dd45de404382c3e037536a513e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:11.565765 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2894eb1-6867-4cd7-988e-233d48ebd471 None admin] RBAC: Authorizing `identity:get_user(user_id=56fbb9dd45de404382c3e037536a513e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:11.567250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2894eb1-6867-4cd7-988e-233d48ebd471 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:11.570834 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 62/134] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:11 2022] GET /identity/v3/users/56fbb9dd45de404382c3e037536a513e => generated 275 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:11.572913 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:11.579970 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2894eb1-6867-4cd7-988e-233d48ebd471 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:11.605271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:11.751927 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2894eb1-6867-4cd7-988e-233d48ebd471 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:11.785038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6b8e3-4723-4706-af80-c7b9ff7d67d5 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:11.829551 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce97246-dd6c-4ef3-8d19-57bf6974e7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:11.830231 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce97246-dd6c-4ef3-8d19-57bf6974e7ba None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:11.831687 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce97246-dd6c-4ef3-8d19-57bf6974e7ba None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:11.831975 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce97246-dd6c-4ef3-8d19-57bf6974e7ba None admin] PATH_INFO: `/v3/projects/2ff11f587a5849f3938f1424a0d2a084` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:11.833383 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce97246-dd6c-4ef3-8d19-57bf6974e7ba None admin] RBAC: Authorizing `identity:get_project(project_id=2ff11f587a5849f3938f1424a0d2a084)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:11.834875 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce97246-dd6c-4ef3-8d19-57bf6974e7ba None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:11.838405 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 63/135] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:11 2022] GET /identity/v3/projects/2ff11f587a5849f3938f1424a0d2a084 => generated 312 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:11.839639 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcb99a-7288-49e6-9cd2-0a404395f3ef None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:11.839926 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcb99a-7288-49e6-9cd2-0a404395f3ef None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:11.840207 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcb99a-7288-49e6-9cd2-0a404395f3ef None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:11.842348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 64/136] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:11.848636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcb99a-7288-49e6-9cd2-0a404395f3ef None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:11.856129 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40977a48-2c21-46c8-aac7-42bf49aeff75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:11.857452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40977a48-2c21-46c8-aac7-42bf49aeff75 None admin] REQUEST_METHOD: `PUT` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:11.857744 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40977a48-2c21-46c8-aac7-42bf49aeff75 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:11.858029 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40977a48-2c21-46c8-aac7-42bf49aeff75 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56/users/56fbb9dd45de404382c3e037536a513e/roles/753aa4902b7544299c8bed1f59c1153e` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:11.865739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40977a48-2c21-46c8-aac7-42bf49aeff75 None admin] RBAC: Authorizing `identity:create_grant(project_id=b54c43bcbc404d39884c37ef65b10c56, user_id=56fbb9dd45de404382c3e037536a513e, role_id=753aa4902b7544299c8bed1f59c1153e)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:11.869661 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40977a48-2c21-46c8-aac7-42bf49aeff75 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:11.961838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:11.979070 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 73/137] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:13:11 2022] PUT /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56/users/56fbb9dd45de404382c3e037536a513e/roles/753aa4902b7544299c8bed1f59c1153e => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 21:13:11.980415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b0d5c-f6e7-4ed1-a515-5aca5d0c6f5b None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:11.980732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b0d5c-f6e7-4ed1-a515-5aca5d0c6f5b None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:11.981010 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b0d5c-f6e7-4ed1-a515-5aca5d0c6f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:11.987476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcb99a-7288-49e6-9cd2-0a404395f3ef None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:12.034365 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727624c9-c168-487e-86f4-43634674165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:12.035051 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727624c9-c168-487e-86f4-43634674165e None admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:12.037047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727624c9-c168-487e-86f4-43634674165e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:12.037047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727624c9-c168-487e-86f4-43634674165e None admin] PATH_INFO: `/v3/projects/2ff11f587a5849f3938f1424a0d2a084/users/56fbb9dd45de404382c3e037536a513e/roles/b7001437cbb84adc825e214c44d6e551` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:12.037929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727624c9-c168-487e-86f4-43634674165e None admin] RBAC: Authorizing `identity:create_grant(project_id=2ff11f587a5849f3938f1424a0d2a084, user_id=56fbb9dd45de404382c3e037536a513e, role_id=b7001437cbb84adc825e214c44d6e551)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:12.039739 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727624c9-c168-487e-86f4-43634674165e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:12.045722 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-499b0d5c-f6e7-4ed1-a515-5aca5d0c6f5b None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:12.047004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-499b0d5c-f6e7-4ed1-a515-5aca5d0c6f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:12.123565 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 65/138] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:13:11 2022] PUT /identity/v3/projects/2ff11f587a5849f3938f1424a0d2a084/users/56fbb9dd45de404382c3e037536a513e/roles/b7001437cbb84adc825e214c44d6e551 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:13:12.193706 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 74/139] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:12.783256 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727624c9-c168-487e-86f4-43634674165e None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:12.910317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727624c9-c168-487e-86f4-43634674165e None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:12.961508 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f514b-3e43-40ae-aba5-ac06d9347419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:12.962147 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f514b-3e43-40ae-aba5-ac06d9347419 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:12.962427 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f514b-3e43-40ae-aba5-ac06d9347419 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:12.962698 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f514b-3e43-40ae-aba5-ac06d9347419 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:12.963819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f514b-3e43-40ae-aba5-ac06d9347419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:12.965308 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f514b-3e43-40ae-aba5-ac06d9347419 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:12.968090 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 66/140] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:13:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:12.972887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b0d5c-f6e7-4ed1-a515-5aca5d0c6f5b None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:12.976172 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:13.118225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b0d5c-f6e7-4ed1-a515-5aca5d0c6f5b None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:13.170046 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4653d5-4f16-47bb-855d-cc096054808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:13.171011 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4653d5-4f16-47bb-855d-cc096054808f None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:13.171496 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4653d5-4f16-47bb-855d-cc096054808f None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:13.171992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4653d5-4f16-47bb-855d-cc096054808f None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:13.173002 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4653d5-4f16-47bb-855d-cc096054808f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:13.174778 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4653d5-4f16-47bb-855d-cc096054808f None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:13.296191 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 75/141] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Sep 3 21:13:12 2022] POST /identity/v3/users => generated 283 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:13:13.316918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9fda7-8c6c-42e8-9557-b13ca2d8e5ae None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:13.317243 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9fda7-8c6c-42e8-9557-b13ca2d8e5ae None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:13.317510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9fda7-8c6c-42e8-9557-b13ca2d8e5ae None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:13.319299 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 67/142] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:13.328383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac665b15-a7d4-43c3-979e-13de8bd8bce3 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:13.329121 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac665b15-a7d4-43c3-979e-13de8bd8bce3 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:13.329601 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac665b15-a7d4-43c3-979e-13de8bd8bce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:13.361950 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-ac665b15-a7d4-43c3-979e-13de8bd8bce3 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:13.363654 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-ac665b15-a7d4-43c3-979e-13de8bd8bce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:13.458851 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:13.479329 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 76/143] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:13:13.784488 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799d642-c8b3-4a5d-a6b2-72d87d56f2b6 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:13.785009 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799d642-c8b3-4a5d-a6b2-72d87d56f2b6 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:13.785009 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799d642-c8b3-4a5d-a6b2-72d87d56f2b6 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:13.786597 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 68/144] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:13.792060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8b94f-e2a8-4f05-b444-d4e0d18ba3be None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:13.792344 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8b94f-e2a8-4f05-b444-d4e0d18ba3be None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:13.792666 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8b94f-e2a8-4f05-b444-d4e0d18ba3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:13.821594 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-ecd8b94f-e2a8-4f05-b444-d4e0d18ba3be None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:13.822806 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-ecd8b94f-e2a8-4f05-b444-d4e0d18ba3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:13.885911 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799d642-c8b3-4a5d-a6b2-72d87d56f2b6 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:13.898412 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:13.930554 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 77/145] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:14.036476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a799d642-c8b3-4a5d-a6b2-72d87d56f2b6 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:14.084896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ba6fa-6667-49cc-b27a-31d0c653a572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:14.085596 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba6fa-6667-49cc-b27a-31d0c653a572 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:14.085879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba6fa-6667-49cc-b27a-31d0c653a572 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:14.086155 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba6fa-6667-49cc-b27a-31d0c653a572 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:14.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ba6fa-6667-49cc-b27a-31d0c653a572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-0d1ba6fa-6667-49cc-b27a-31d0c653a572 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:14.111776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:14.112723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:14.113492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:14.113492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:14.113492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:14.113492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:14.113492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:14.113492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:14.113492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:14.113492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:14.113492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:14.113492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:14.113492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:14.113492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:14.113492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 69/146] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:13:14.120727 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8b94f-e2a8-4f05-b444-d4e0d18ba3be None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:14.250824 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8b94f-e2a8-4f05-b444-d4e0d18ba3be None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:14.274323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:14.293867 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97fd58-c01a-4d93-a9ff-672d802bf7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:14.293867 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97fd58-c01a-4d93-a9ff-672d802bf7f5 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:14.293867 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97fd58-c01a-4d93-a9ff-672d802bf7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:14.293867 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97fd58-c01a-4d93-a9ff-672d802bf7f5 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:14.295297 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97fd58-c01a-4d93-a9ff-672d802bf7f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:14.295297 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97fd58-c01a-4d93-a9ff-672d802bf7f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:14.295297 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97fd58-c01a-4d93-a9ff-672d802bf7f5 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:14.308472 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 78/147] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:14.315338 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ba6fa-6667-49cc-b27a-31d0c653a572 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:14.358170 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b78b4b-8035-4e75-bbb4-ff61a8c14c8d None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:14.358468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b78b4b-8035-4e75-bbb4-ff61a8c14c8d None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:14.358719 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b78b4b-8035-4e75-bbb4-ff61a8c14c8d None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:14.360142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 79/148] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:13:14.366505 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bea2df-6ce9-4b06-9f5c-854cbd8853f0 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:14.366784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bea2df-6ce9-4b06-9f5c-854cbd8853f0 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:14.367039 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bea2df-6ce9-4b06-9f5c-854cbd8853f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:14.395993 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-36bea2df-6ce9-4b06-9f5c-854cbd8853f0 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:14.397206 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-36bea2df-6ce9-4b06-9f5c-854cbd8853f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:14.435848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:14.496379 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ba6fa-6667-49cc-b27a-31d0c653a572 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:14.533800 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 80/149] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:13:14.570508 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa44f72-b692-4f6d-911e-9ee2863d21ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:14.571073 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa44f72-b692-4f6d-911e-9ee2863d21ca None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:14.571353 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa44f72-b692-4f6d-911e-9ee2863d21ca None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:14.571626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa44f72-b692-4f6d-911e-9ee2863d21ca None admin] PATH_INFO: `/v3/users/52beb353a5f0479da28ac6e5cef06318` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:14.572817 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa44f72-b692-4f6d-911e-9ee2863d21ca None admin] RBAC: Authorizing `identity:get_user(user_id=52beb353a5f0479da28ac6e5cef06318)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:14.574285 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa44f72-b692-4f6d-911e-9ee2863d21ca None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:14.576768 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 70/150] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:14 2022] GET /identity/v3/users/52beb353a5f0479da28ac6e5cef06318 => generated 289 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:14.582284 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bea2df-6ce9-4b06-9f5c-854cbd8853f0 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:14.585725 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa44f72-b692-4f6d-911e-9ee2863d21ca None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:14.802503 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa44f72-b692-4f6d-911e-9ee2863d21ca None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:14.822334 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bea2df-6ce9-4b06-9f5c-854cbd8853f0 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:14.848566 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:14.868210 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb4c3a-a52a-4c9a-8896-29acb99de4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:14.868963 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb4c3a-a52a-4c9a-8896-29acb99de4e2 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:14.869243 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb4c3a-a52a-4c9a-8896-29acb99de4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:14.869513 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb4c3a-a52a-4c9a-8896-29acb99de4e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:14.876269 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:14.893647 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb4c3a-a52a-4c9a-8896-29acb99de4e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-48bb4c3a-a52a-4c9a-8896-29acb99de4e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:14.898853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:14.899722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:14.900502 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:14.900502 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:14.900502 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:14.900502 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:14.900502 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:14.900502 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:14.900502 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:14.900502 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:14.900502 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:14.900502 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:14.900502 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:14.900502 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:14.900502 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 71/151] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:13:14.910606 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0487f-60c8-4a86-b759-8bfe822b35f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:14.911321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0487f-60c8-4a86-b759-8bfe822b35f0 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:14.911601 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0487f-60c8-4a86-b759-8bfe822b35f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:14.911980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0487f-60c8-4a86-b759-8bfe822b35f0 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:14.913960 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb4c3a-a52a-4c9a-8896-29acb99de4e2 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:14.915002 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0487f-60c8-4a86-b759-8bfe822b35f0 None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:14.916475 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0487f-60c8-4a86-b759-8bfe822b35f0 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:14.918660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 81/152] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:14 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:14.924667 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0487f-60c8-4a86-b759-8bfe822b35f0 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:15.142737 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb4c3a-a52a-4c9a-8896-29acb99de4e2 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:15.154029 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0487f-60c8-4a86-b759-8bfe822b35f0 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:15.193466 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067c561-4d5d-49ed-a14d-8cd7811fc25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:15.194507 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067c561-4d5d-49ed-a14d-8cd7811fc25f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:15.195004 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067c561-4d5d-49ed-a14d-8cd7811fc25f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:15.195745 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067c561-4d5d-49ed-a14d-8cd7811fc25f None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:15.200552 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067c561-4d5d-49ed-a14d-8cd7811fc25f None admin] RBAC: Adding query filter params (name=member) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:15.200552 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067c561-4d5d-49ed-a14d-8cd7811fc25f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:15.200552 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067c561-4d5d-49ed-a14d-8cd7811fc25f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:15.205607 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a33ae-5a84-4514-9cf2-6563cfbabeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:15.206783 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a33ae-5a84-4514-9cf2-6563cfbabeb4 None admin] REQUEST_METHOD: `PUT` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:15.207270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a33ae-5a84-4514-9cf2-6563cfbabeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:15.207744 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a33ae-5a84-4514-9cf2-6563cfbabeb4 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56/users/52beb353a5f0479da28ac6e5cef06318/roles/46aa5e1d5e704ae78369f7707f6977dc` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:15.213990 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a33ae-5a84-4514-9cf2-6563cfbabeb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b54c43bcbc404d39884c37ef65b10c56, user_id=52beb353a5f0479da28ac6e5cef06318, role_id=46aa5e1d5e704ae78369f7707f6977dc)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:15.214525 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 72/153] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:15.215379 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067c561-4d5d-49ed-a14d-8cd7811fc25f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:15.217227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a33ae-5a84-4514-9cf2-6563cfbabeb4 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:15.287632 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:15.310965 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 82/154] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:13:14 2022] PUT /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56/users/52beb353a5f0479da28ac6e5cef06318/roles/46aa5e1d5e704ae78369f7707f6977dc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 21:13:15.312666 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a33ae-5a84-4514-9cf2-6563cfbabeb4 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:15.337265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067c561-4d5d-49ed-a14d-8cd7811fc25f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:15.383053 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79998125-6027-41c7-8bcd-859dbbfc0a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:15.383265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79998125-6027-41c7-8bcd-859dbbfc0a64 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:15.383621 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79998125-6027-41c7-8bcd-859dbbfc0a64 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:15.384036 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79998125-6027-41c7-8bcd-859dbbfc0a64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:15.396803 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:15.402815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79998125-6027-41c7-8bcd-859dbbfc0a64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-79998125-6027-41c7-8bcd-859dbbfc0a64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:15.416582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:15.417556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:15.418577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:15.418577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:15.418577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:15.418577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:15.418577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:15.418577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:15.418577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:15.418577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:15.418577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:15.418577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:15.418577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:15.418577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:15.418577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 73/155] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:13:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:15.424040 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79998125-6027-41c7-8bcd-859dbbfc0a64 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:15.534494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a33ae-5a84-4514-9cf2-6563cfbabeb4 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:15.582352 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79998125-6027-41c7-8bcd-859dbbfc0a64 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:15.608910 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:15.613999 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a13ab-446a-4697-886c-d8426bbb6854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:15.614662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a13ab-446a-4697-886c-d8426bbb6854 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:15.614947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a13ab-446a-4697-886c-d8426bbb6854 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:15.615220 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a13ab-446a-4697-886c-d8426bbb6854 None admin] PATH_INFO: `/v3/users/56fbb9dd45de404382c3e037536a513e` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:15.617520 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a13ab-446a-4697-886c-d8426bbb6854 None admin] RBAC: Authorizing `identity:get_user(user_id=56fbb9dd45de404382c3e037536a513e)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:15.619093 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a13ab-446a-4697-886c-d8426bbb6854 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:15.624647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 83/156] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:15 2022] GET /identity/v3/users/56fbb9dd45de404382c3e037536a513e => generated 275 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:15.627705 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a13ab-446a-4697-886c-d8426bbb6854 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:15.633334 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478a722-4c72-4279-b8ac-46be01d83094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:15.634352 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a722-4c72-4279-b8ac-46be01d83094 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:15.634829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a722-4c72-4279-b8ac-46be01d83094 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:15.635332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a722-4c72-4279-b8ac-46be01d83094 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:15.636198 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478a722-4c72-4279-b8ac-46be01d83094 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:15.636710 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478a722-4c72-4279-b8ac-46be01d83094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:15.638476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478a722-4c72-4279-b8ac-46be01d83094 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:15.655527 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 74/157] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:15.661263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478a722-4c72-4279-b8ac-46be01d83094 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:15.788589 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a13ab-446a-4697-886c-d8426bbb6854 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:15.807613 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:15.821268 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478a722-4c72-4279-b8ac-46be01d83094 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:15.852446 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b25cc-73f8-4b41-8a90-e1becf675047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:15.853111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b25cc-73f8-4b41-8a90-e1becf675047 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:15.853391 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b25cc-73f8-4b41-8a90-e1becf675047 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:15.853660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b25cc-73f8-4b41-8a90-e1becf675047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:15.882246 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b757ae-8f51-4429-9adc-1db21a9ca83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:15.883293 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b757ae-8f51-4429-9adc-1db21a9ca83b None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:15.883860 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b757ae-8f51-4429-9adc-1db21a9ca83b None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:15.884345 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b757ae-8f51-4429-9adc-1db21a9ca83b None admin] PATH_INFO: `/v3/users/3e2bd2fbe30f4ddbb48bb8150f222665` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:15.885894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b757ae-8f51-4429-9adc-1db21a9ca83b None admin] RBAC: Authorizing `identity:get_user(user_id=3e2bd2fbe30f4ddbb48bb8150f222665)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:15.888432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b757ae-8f51-4429-9adc-1db21a9ca83b None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:15.895089 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 75/158] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:15 2022] GET /identity/v3/users/3e2bd2fbe30f4ddbb48bb8150f222665 => generated 247 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:15.901189 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b757ae-8f51-4429-9adc-1db21a9ca83b None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:15.991344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:16.023332 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b25cc-73f8-4b41-8a90-e1becf675047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:16.025007 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b25cc-73f8-4b41-8a90-e1becf675047 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:16.097267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b757ae-8f51-4429-9adc-1db21a9ca83b None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:16.181073 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33f567-153f-49e6-9c05-8e5b25de7059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:16.181709 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33f567-153f-49e6-9c05-8e5b25de7059 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:16.181992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33f567-153f-49e6-9c05-8e5b25de7059 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:16.182265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33f567-153f-49e6-9c05-8e5b25de7059 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:16.274627 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 84/159] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:16.276029 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7fcb8-52af-4a90-a2e7-3f588852a9a2 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:16.276310 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7fcb8-52af-4a90-a2e7-3f588852a9a2 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:16.276602 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae7fcb8-52af-4a90-a2e7-3f588852a9a2 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:16.277903 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 85/160] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:16.281636 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7fcb8-52af-4a90-a2e7-3f588852a9a2 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:16.299914 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:16.310004 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33f567-153f-49e6-9c05-8e5b25de7059 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:16.312110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33f567-153f-49e6-9c05-8e5b25de7059 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:16.397647 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:16.495153 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 76/161] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 21:13:16.498285 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae7fcb8-52af-4a90-a2e7-3f588852a9a2 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:16.501515 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469b1b4-c83f-4828-a6b2-668dc784dcd8 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:16.501806 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469b1b4-c83f-4828-a6b2-668dc784dcd8 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:16.502087 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469b1b4-c83f-4828-a6b2-668dc784dcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:16.546219 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-5469b1b4-c83f-4828-a6b2-668dc784dcd8 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:16.547360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-5469b1b4-c83f-4828-a6b2-668dc784dcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:16.604059 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f5942-c34c-4c27-89a7-c7fc3189a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:16.604979 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f5942-c34c-4c27-89a7-c7fc3189a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:16.605336 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f5942-c34c-4c27-89a7-c7fc3189a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:16.605616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f5942-c34c-4c27-89a7-c7fc3189a3d8 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:16.606810 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f5942-c34c-4c27-89a7-c7fc3189a3d8 None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:16.608249 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f5942-c34c-4c27-89a7-c7fc3189a3d8 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:16.609915 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 86/162] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:16 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:16.611928 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09321e69-8451-434e-abdd-8884e8ffd645 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:16.612212 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09321e69-8451-434e-abdd-8884e8ffd645 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:16.612482 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09321e69-8451-434e-abdd-8884e8ffd645 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:16.613782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 87/163] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:16.618389 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09321e69-8451-434e-abdd-8884e8ffd645 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:16.678550 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 77/164] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:16.679758 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469b1b4-c83f-4828-a6b2-668dc784dcd8 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:16.775079 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:16.814616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09321e69-8451-434e-abdd-8884e8ffd645 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:16.868813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ecb2c-2ffe-41f7-a11b-7b5b859b0933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:16.869811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ecb2c-2ffe-41f7-a11b-7b5b859b0933 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:16.870237 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ecb2c-2ffe-41f7-a11b-7b5b859b0933 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:16.870703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ecb2c-2ffe-41f7-a11b-7b5b859b0933 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:16.875784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ecb2c-2ffe-41f7-a11b-7b5b859b0933 None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:16.877511 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ecb2c-2ffe-41f7-a11b-7b5b859b0933 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:16.879392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 88/165] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:16 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:16.880727 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce97995-21cb-4afb-bd05-a400648b5c51 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:16.881215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce97995-21cb-4afb-bd05-a400648b5c51 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:16.881631 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce97995-21cb-4afb-bd05-a400648b5c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:16.891297 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:16.909602 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-6ce97995-21cb-4afb-bd05-a400648b5c51 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:16.911045 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-6ce97995-21cb-4afb-bd05-a400648b5c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:16.956554 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469b1b4-c83f-4828-a6b2-668dc784dcd8 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:17.037418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 89/166] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:17.038294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce97995-21cb-4afb-bd05-a400648b5c51 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:17.062925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c7c0d-4a95-4b81-b5f5-5699ac11d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:17.063547 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c7c0d-4a95-4b81-b5f5-5699ac11d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:17.063828 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c7c0d-4a95-4b81-b5f5-5699ac11d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:17.064103 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c7c0d-4a95-4b81-b5f5-5699ac11d2d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:17.064926 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c7c0d-4a95-4b81-b5f5-5699ac11d2d1 None admin] RBAC: Adding query filter params (role.id=b7001437cbb84adc825e214c44d6e551, scope.project.id=b54c43bcbc404d39884c37ef65b10c56, user.id=56fbb9dd45de404382c3e037536a513e) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:17.065180 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c7c0d-4a95-4b81-b5f5-5699ac11d2d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:17.066661 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c7c0d-4a95-4b81-b5f5-5699ac11d2d1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:17.086719 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 78/167] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:16 2022] GET /identity/v3/role_assignments?user.id=56fbb9dd45de404382c3e037536a513e&scope.project.id=b54c43bcbc404d39884c37ef65b10c56&role.id=b7001437cbb84adc825e214c44d6e551 => generated 608 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:17.175618 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:17.212891 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce97995-21cb-4afb-bd05-a400648b5c51 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:17.266548 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbca1e2-9102-477c-b0e4-79d6b6055c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:17.267435 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbca1e2-9102-477c-b0e4-79d6b6055c79 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:17.267848 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbca1e2-9102-477c-b0e4-79d6b6055c79 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:17.268243 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbca1e2-9102-477c-b0e4-79d6b6055c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:17.269011 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbca1e2-9102-477c-b0e4-79d6b6055c79 None admin] RBAC: Adding query filter params (role.id=a1c22a1558c34c1d9d262bf1da31887e, scope.project.id=b54c43bcbc404d39884c37ef65b10c56, user.id=3e2bd2fbe30f4ddbb48bb8150f222665) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:17.269322 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbca1e2-9102-477c-b0e4-79d6b6055c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:17.270780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbca1e2-9102-477c-b0e4-79d6b6055c79 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:17.276890 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c7c0d-4a95-4b81-b5f5-5699ac11d2d1 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:17.284205 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 90/168] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:17 2022] GET /identity/v3/role_assignments?user.id=3e2bd2fbe30f4ddbb48bb8150f222665&scope.project.id=b54c43bcbc404d39884c37ef65b10c56&role.id=a1c22a1558c34c1d9d262bf1da31887e => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:17.437034 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c7c0d-4a95-4b81-b5f5-5699ac11d2d1 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:17.488172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba8eb8-acb0-49e6-906e-029f20868a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:17.488847 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba8eb8-acb0-49e6-906e-029f20868a4a None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:17.489132 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba8eb8-acb0-49e6-906e-029f20868a4a None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:17.489405 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba8eb8-acb0-49e6-906e-029f20868a4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:17.502867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba8eb8-acb0-49e6-906e-029f20868a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-b4ba8eb8-acb0-49e6-906e-029f20868a4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:17.508879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:17.509833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:17.510624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:17.510624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:17.510624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:17.510624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:17.510624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:17.510624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:17.510624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:17.510624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:17.510624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:17.510624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:17.510624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:17.510624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:17.513480 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 79/169] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:13:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:13:17.525708 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbca1e2-9102-477c-b0e4-79d6b6055c79 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:17.697817 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbca1e2-9102-477c-b0e4-79d6b6055c79 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:17.744140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0697f-659c-4932-9eb2-61093b009caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:17.744935 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0697f-659c-4932-9eb2-61093b009caf None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:17.745080 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0697f-659c-4932-9eb2-61093b009caf None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:17.745327 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0697f-659c-4932-9eb2-61093b009caf None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:17.746004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0697f-659c-4932-9eb2-61093b009caf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:17.746313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0697f-659c-4932-9eb2-61093b009caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:17.748578 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0697f-659c-4932-9eb2-61093b009caf None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:17.757291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:17.761206 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 91/170] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:13:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:17.769972 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba8eb8-acb0-49e6-906e-029f20868a4a None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:17.772986 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:17.820433 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0697f-659c-4932-9eb2-61093b009caf None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:17.947973 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba8eb8-acb0-49e6-906e-029f20868a4a None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:18.029444 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16585c1e-5dc8-40ca-b299-5580771e43c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:18.030206 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16585c1e-5dc8-40ca-b299-5580771e43c6 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:18.030489 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16585c1e-5dc8-40ca-b299-5580771e43c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:18.030764 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16585c1e-5dc8-40ca-b299-5580771e43c6 None admin] PATH_INFO: `/v3/users/56fbb9dd45de404382c3e037536a513e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:18.033093 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16585c1e-5dc8-40ca-b299-5580771e43c6 None admin] RBAC: Authorizing `identity:get_user(user_id=56fbb9dd45de404382c3e037536a513e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:18.034798 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16585c1e-5dc8-40ca-b299-5580771e43c6 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:18.036824 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 80/171] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:17 2022] GET /identity/v3/users/56fbb9dd45de404382c3e037536a513e => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:18.044435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16585c1e-5dc8-40ca-b299-5580771e43c6 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:18.062681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0697f-659c-4932-9eb2-61093b009caf None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:18.165265 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983e488-ed39-4fa1-9c94-c12c5afd94ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:18.166209 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983e488-ed39-4fa1-9c94-c12c5afd94ad None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:18.166643 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983e488-ed39-4fa1-9c94-c12c5afd94ad None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:18.167080 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983e488-ed39-4fa1-9c94-c12c5afd94ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:18.182958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:18.194414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983e488-ed39-4fa1-9c94-c12c5afd94ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-4983e488-ed39-4fa1-9c94-c12c5afd94ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:18.211294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:18.212397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:18.213415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:18.213415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:18.213415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:18.213415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:18.213415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:18.213415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:18.213415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:18.213415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:18.213415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:18.213415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:18.213415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:18.213415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:18.219224 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 92/172] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:18.223227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983e488-ed39-4fa1-9c94-c12c5afd94ad None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:18.266586 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16585c1e-5dc8-40ca-b299-5580771e43c6 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:18.324316 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beeb23-fa7f-464a-89fb-38b9ada4e05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:18.325576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beeb23-fa7f-464a-89fb-38b9ada4e05f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:18.325856 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beeb23-fa7f-464a-89fb-38b9ada4e05f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:18.326127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1beeb23-fa7f-464a-89fb-38b9ada4e05f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:18.373741 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:18.441889 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beeb23-fa7f-464a-89fb-38b9ada4e05f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:18.443778 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1beeb23-fa7f-464a-89fb-38b9ada4e05f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:18.467407 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983e488-ed39-4fa1-9c94-c12c5afd94ad None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:18.520905 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:18.540175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760e833-10f9-4479-9871-ca4fb5c85895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:18.540820 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760e833-10f9-4479-9871-ca4fb5c85895 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:18.541100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760e833-10f9-4479-9871-ca4fb5c85895 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:18.541367 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760e833-10f9-4479-9871-ca4fb5c85895 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:18.542062 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760e833-10f9-4479-9871-ca4fb5c85895 None admin] RBAC: Adding query filter params (name=member) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:18.542364 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760e833-10f9-4479-9871-ca4fb5c85895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:18.544099 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760e833-10f9-4479-9871-ca4fb5c85895 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:18.562161 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 93/173] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:18.563790 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bce262-c988-4b72-af31-54e212ca19cf None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:18.564103 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 81/174] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 21:13:18.564553 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bce262-c988-4b72-af31-54e212ca19cf None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:18.565039 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bce262-c988-4b72-af31-54e212ca19cf None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:18.566570 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 94/175] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:18.569551 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beeb23-fa7f-464a-89fb-38b9ada4e05f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:18.573190 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bce262-c988-4b72-af31-54e212ca19cf None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:18.774224 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1beeb23-fa7f-464a-89fb-38b9ada4e05f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:18.802185 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bce262-c988-4b72-af31-54e212ca19cf None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:18.814129 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71203942-70d0-41f6-808f-d3e53aa5fcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:18.815125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71203942-70d0-41f6-808f-d3e53aa5fcbc None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:18.815643 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71203942-70d0-41f6-808f-d3e53aa5fcbc None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:18.816247 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71203942-70d0-41f6-808f-d3e53aa5fcbc None admin] PATH_INFO: `/v3/users/56fbb9dd45de404382c3e037536a513e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:18.817867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71203942-70d0-41f6-808f-d3e53aa5fcbc None admin] RBAC: Authorizing `identity:get_user(user_id=56fbb9dd45de404382c3e037536a513e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:18.819569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71203942-70d0-41f6-808f-d3e53aa5fcbc None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:18.821426 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 82/176] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:18 2022] GET /identity/v3/users/56fbb9dd45de404382c3e037536a513e => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:18.822857 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef00e4-ba98-4738-a7eb-de75c632d3a0 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:18.823373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef00e4-ba98-4738-a7eb-de75c632d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:18.823882 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef00e4-ba98-4738-a7eb-de75c632d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:18.844327 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-5aef00e4-ba98-4738-a7eb-de75c632d3a0 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:18.846159 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-5aef00e4-ba98-4738-a7eb-de75c632d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:18.874310 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:18.911840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:18.927032 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 83/177] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:18.928408 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef00e4-ba98-4738-a7eb-de75c632d3a0 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:18.938754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d365e3-975e-4dc6-a61f-921b64cad662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:18.938964 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d365e3-975e-4dc6-a61f-921b64cad662 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:18.939251 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d365e3-975e-4dc6-a61f-921b64cad662 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:18.939533 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d365e3-975e-4dc6-a61f-921b64cad662 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:18.940727 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d365e3-975e-4dc6-a61f-921b64cad662 None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:18.942215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d365e3-975e-4dc6-a61f-921b64cad662 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:18.953933 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 95/178] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:18 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:18.958954 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d365e3-975e-4dc6-a61f-921b64cad662 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:19.087695 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef00e4-ba98-4738-a7eb-de75c632d3a0 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:19.128683 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de3d91-6f65-45f4-8035-a0c6942ad603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:19.129401 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3d91-6f65-45f4-8035-a0c6942ad603 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:19.129747 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3d91-6f65-45f4-8035-a0c6942ad603 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:19.130095 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de3d91-6f65-45f4-8035-a0c6942ad603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:19.145265 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d365e3-975e-4dc6-a61f-921b64cad662 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:19.172733 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:19.182951 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1eba4-2660-4b74-b7c8-6a201cb45944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:19.183593 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1eba4-2660-4b74-b7c8-6a201cb45944 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:19.183879 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1eba4-2660-4b74-b7c8-6a201cb45944 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:19.184406 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1eba4-2660-4b74-b7c8-6a201cb45944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:19.185222 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1eba4-2660-4b74-b7c8-6a201cb45944 None admin] RBAC: Adding query filter params (role.id=753aa4902b7544299c8bed1f59c1153e, scope.project.id=b54c43bcbc404d39884c37ef65b10c56, user.id=56fbb9dd45de404382c3e037536a513e) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:19.185538 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1eba4-2660-4b74-b7c8-6a201cb45944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:19.187128 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1eba4-2660-4b74-b7c8-6a201cb45944 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:19.193517 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 96/179] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:18 2022] GET /identity/v3/role_assignments?user.id=56fbb9dd45de404382c3e037536a513e&scope.project.id=b54c43bcbc404d39884c37ef65b10c56&role.id=753aa4902b7544299c8bed1f59c1153e => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:19.194753 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e685b-6e26-4611-a6e5-e307a9b833ce None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:19.195097 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e685b-6e26-4611-a6e5-e307a9b833ce None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:19.195439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e685b-6e26-4611-a6e5-e307a9b833ce None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:19.196852 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 97/180] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:19.197739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c2aad-b537-434f-ad88-75b6eada06e8 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:19.198022 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c2aad-b537-434f-ad88-75b6eada06e8 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:19.198295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c2aad-b537-434f-ad88-75b6eada06e8 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:19.200012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 98/181] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:19.205328 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad1e55-5e4d-4a23-aa8b-9a95cb8ae0f8 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:19.205637 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad1e55-5e4d-4a23-aa8b-9a95cb8ae0f8 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:19.205940 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad1e55-5e4d-4a23-aa8b-9a95cb8ae0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:19.227031 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de3d91-6f65-45f4-8035-a0c6942ad603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:19.229040 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de3d91-6f65-45f4-8035-a0c6942ad603 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:19.235359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-68ad1e55-5e4d-4a23-aa8b-9a95cb8ae0f8 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:19.236714 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-68ad1e55-5e4d-4a23-aa8b-9a95cb8ae0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:19.298450 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:19.314342 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 99/182] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:13:19.316138 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a42a-11c9-40d2-8fbb-4016f4dce26e None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:19.316588 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a42a-11c9-40d2-8fbb-4016f4dce26e None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:19.316963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227a42a-11c9-40d2-8fbb-4016f4dce26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:19.338238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-6227a42a-11c9-40d2-8fbb-4016f4dce26e None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:19.339676 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-6227a42a-11c9-40d2-8fbb-4016f4dce26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:19.400710 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 84/183] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:19.402206 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91236c0-4bcc-4383-a278-eafdeaaa5f14 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:19.402628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91236c0-4bcc-4383-a278-eafdeaaa5f14 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:19.403533 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91236c0-4bcc-4383-a278-eafdeaaa5f14 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:19.405049 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 85/184] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:19.409531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91236c0-4bcc-4383-a278-eafdeaaa5f14 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:19.458514 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 100/185] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:19.460038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144f1ad-5cfa-4394-b7cf-7b2246afb7ef None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:19.460399 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144f1ad-5cfa-4394-b7cf-7b2246afb7ef None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:19.460972 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144f1ad-5cfa-4394-b7cf-7b2246afb7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:19.480158 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-b144f1ad-5cfa-4394-b7cf-7b2246afb7ef None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:19.482486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-b144f1ad-5cfa-4394-b7cf-7b2246afb7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:19.502496 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:19.545458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91236c0-4bcc-4383-a278-eafdeaaa5f14 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:19.566059 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 101/186] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:19.566729 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144f1ad-5cfa-4394-b7cf-7b2246afb7ef None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:19.593833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85762589-3159-4409-bac9-01fb347b26d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:19.595020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85762589-3159-4409-bac9-01fb347b26d7 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:19.595546 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85762589-3159-4409-bac9-01fb347b26d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:19.596054 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85762589-3159-4409-bac9-01fb347b26d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:19.612464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85762589-3159-4409-bac9-01fb347b26d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-85762589-3159-4409-bac9-01fb347b26d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:19.618404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:19.619347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:19.620130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:19.620130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:19.620130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:19.620130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:19.620130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:19.620130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:19.620130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:19.620130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:19.620130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:19.620130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:19.620130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:19.620130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:19.623057 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 86/187] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:13:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:19.624559 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:19.630580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85762589-3159-4409-bac9-01fb347b26d7 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:19.699124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144f1ad-5cfa-4394-b7cf-7b2246afb7ef None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:19.749056 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1c7b4-b76b-44c1-99e7-2dda2764c4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:19.750364 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1c7b4-b76b-44c1-99e7-2dda2764c4e8 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:19.750881 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1c7b4-b76b-44c1-99e7-2dda2764c4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:19.751630 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1c7b4-b76b-44c1-99e7-2dda2764c4e8 None admin] PATH_INFO: `/v3/projects/2ff11f587a5849f3938f1424a0d2a084` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:19.753776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1c7b4-b76b-44c1-99e7-2dda2764c4e8 None admin] RBAC: Authorizing `identity:get_project(project_id=2ff11f587a5849f3938f1424a0d2a084)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:19.756312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1c7b4-b76b-44c1-99e7-2dda2764c4e8 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:19.759338 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 102/188] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:19 2022] GET /identity/v3/projects/2ff11f587a5849f3938f1424a0d2a084 => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:19.765598 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1c7b4-b76b-44c1-99e7-2dda2764c4e8 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:19.765754 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85762589-3159-4409-bac9-01fb347b26d7 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:19.795803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:19.804922 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d30762-b0a7-4c8f-b6b8-8e7fa0bdc6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:19.805774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d30762-b0a7-4c8f-b6b8-8e7fa0bdc6d5 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:19.806156 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d30762-b0a7-4c8f-b6b8-8e7fa0bdc6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:19.806581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d30762-b0a7-4c8f-b6b8-8e7fa0bdc6d5 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:19.807482 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d30762-b0a7-4c8f-b6b8-8e7fa0bdc6d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:19.807877 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d30762-b0a7-4c8f-b6b8-8e7fa0bdc6d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:19.810286 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d30762-b0a7-4c8f-b6b8-8e7fa0bdc6d5 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:19.819545 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 87/189] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:19.820577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d30762-b0a7-4c8f-b6b8-8e7fa0bdc6d5 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:19.914350 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1c7b4-b76b-44c1-99e7-2dda2764c4e8 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:19.928747 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:19.947290 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d30762-b0a7-4c8f-b6b8-8e7fa0bdc6d5 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:19.951671 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a39e9e-5ab0-42c3-b8a7-b9ad317c2521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:19.952368 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a39e9e-5ab0-42c3-b8a7-b9ad317c2521 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:19.952687 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a39e9e-5ab0-42c3-b8a7-b9ad317c2521 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:19.952964 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a39e9e-5ab0-42c3-b8a7-b9ad317c2521 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:19.966656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a39e9e-5ab0-42c3-b8a7-b9ad317c2521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-21a39e9e-5ab0-42c3-b8a7-b9ad317c2521 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:19.971700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:19.972832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:19.973656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:19.973656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:19.973656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:19.973656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:19.973656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:19.973656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:19.973656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:19.973656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:19.973656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:19.973656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:19.973656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:19.973656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:19.973656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 103/190] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:19.974322 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a39e9e-5ab0-42c3-b8a7-b9ad317c2521 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:19.985911 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342c18a-d807-45d6-8035-71a75fd3a639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:19.986521 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342c18a-d807-45d6-8035-71a75fd3a639 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:19.986809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342c18a-d807-45d6-8035-71a75fd3a639 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:19.987083 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342c18a-d807-45d6-8035-71a75fd3a639 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:19.987878 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342c18a-d807-45d6-8035-71a75fd3a639 None admin] RBAC: Adding query filter params (role.id=b7001437cbb84adc825e214c44d6e551, scope.project.id=2ff11f587a5849f3938f1424a0d2a084, user.id=56fbb9dd45de404382c3e037536a513e) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:19.988191 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342c18a-d807-45d6-8035-71a75fd3a639 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:19.989683 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342c18a-d807-45d6-8035-71a75fd3a639 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:19.996048 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 88/191] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:19 2022] GET /identity/v3/role_assignments?user.id=56fbb9dd45de404382c3e037536a513e&scope.project.id=2ff11f587a5849f3938f1424a0d2a084&role.id=b7001437cbb84adc825e214c44d6e551 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:19.997756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342c18a-d807-45d6-8035-71a75fd3a639 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:20.074377 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:20.099753 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a39e9e-5ab0-42c3-b8a7-b9ad317c2521 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:20.131140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342c18a-d807-45d6-8035-71a75fd3a639 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:20.150015 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43588b7d-31a9-4a24-8fd9-dd6951109a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:20.155213 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43588b7d-31a9-4a24-8fd9-dd6951109a30 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:20.155484 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43588b7d-31a9-4a24-8fd9-dd6951109a30 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:20.155762 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43588b7d-31a9-4a24-8fd9-dd6951109a30 None admin] PATH_INFO: `/v3/users/330389040c4347b6b47e22817fa80efc` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:20.171792 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5d53b-3bbb-4996-b65f-c381bdea5d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:20.171990 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43588b7d-31a9-4a24-8fd9-dd6951109a30 None admin] RBAC: Authorizing `identity:get_user(user_id=330389040c4347b6b47e22817fa80efc)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:20.172353 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5d53b-3bbb-4996-b65f-c381bdea5d2d None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:20.172670 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5d53b-3bbb-4996-b65f-c381bdea5d2d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:20.172965 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5d53b-3bbb-4996-b65f-c381bdea5d2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:20.173490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43588b7d-31a9-4a24-8fd9-dd6951109a30 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:20.174088 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5d53b-3bbb-4996-b65f-c381bdea5d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:20.179807 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 104/192] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:19 2022] GET /identity/v3/users/330389040c4347b6b47e22817fa80efc => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:20.179982 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5d53b-3bbb-4996-b65f-c381bdea5d2d None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:20.180061 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43588b7d-31a9-4a24-8fd9-dd6951109a30 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:20.180139 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 89/193] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:13:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:20.180206 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5d53b-3bbb-4996-b65f-c381bdea5d2d None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:20.221919 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:20.300237 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43588b7d-31a9-4a24-8fd9-dd6951109a30 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:20.308708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5d53b-3bbb-4996-b65f-c381bdea5d2d None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:20.331681 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:20.335274 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa632e66-a7db-44f8-8256-2da4ed24f45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:20.335909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa632e66-a7db-44f8-8256-2da4ed24f45e None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:20.336191 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa632e66-a7db-44f8-8256-2da4ed24f45e None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:20.336469 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa632e66-a7db-44f8-8256-2da4ed24f45e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:20.343107 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47fcb9-0fd7-4b39-9524-9e028801df9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:20.344895 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47fcb9-0fd7-4b39-9524-9e028801df9b None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:20.344895 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47fcb9-0fd7-4b39-9524-9e028801df9b None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:20.344895 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47fcb9-0fd7-4b39-9524-9e028801df9b None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:20.344895 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47fcb9-0fd7-4b39-9524-9e028801df9b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:20.345352 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47fcb9-0fd7-4b39-9524-9e028801df9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:20.346588 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47fcb9-0fd7-4b39-9524-9e028801df9b None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:20.347333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa632e66-a7db-44f8-8256-2da4ed24f45e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-fa632e66-a7db-44f8-8256-2da4ed24f45e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:20.352291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:20.353346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:20.354124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:20.354124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:20.354124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:20.354124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:20.354124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:20.354124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:20.354124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:20.354124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:20.354124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:20.354124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:20.354124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:20.354124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:20.354124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 105/194] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:13:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:20.354815 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa632e66-a7db-44f8-8256-2da4ed24f45e None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:20.355544 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 90/195] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:20.361797 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47fcb9-0fd7-4b39-9524-9e028801df9b None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:20.454444 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:20.463735 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47fcb9-0fd7-4b39-9524-9e028801df9b None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:20.476620 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa632e66-a7db-44f8-8256-2da4ed24f45e None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:20.500630 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7248b-44e6-43aa-9eec-4f03e715d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:20.500995 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd36d8-5c92-46a1-a565-f29eaf2c43bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:20.501243 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7248b-44e6-43aa-9eec-4f03e715d2ef None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:20.501521 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7248b-44e6-43aa-9eec-4f03e715d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:20.501612 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd36d8-5c92-46a1-a565-f29eaf2c43bc None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:20.501793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7248b-44e6-43aa-9eec-4f03e715d2ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:20.501889 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd36d8-5c92-46a1-a565-f29eaf2c43bc None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:20.502134 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd36d8-5c92-46a1-a565-f29eaf2c43bc None admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:20.502786 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd36d8-5c92-46a1-a565-f29eaf2c43bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:20.504245 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd36d8-5c92-46a1-a565-f29eaf2c43bc None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:20.573088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7248b-44e6-43aa-9eec-4f03e715d2ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:20.574654 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7248b-44e6-43aa-9eec-4f03e715d2ef None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:20.613732 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 91/196] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Sep 3 21:13:20 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:13:20.614581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd36d8-5c92-46a1-a565-f29eaf2c43bc None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:20.669436 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:20.684021 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:20.697633 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 106/197] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:20.698356 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7248b-44e6-43aa-9eec-4f03e715d2ef None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:20.751749 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd36d8-5c92-46a1-a565-f29eaf2c43bc None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:20.792012 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea0cc6-2334-4f9f-97c4-494650f775d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:20.792668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea0cc6-2334-4f9f-97c4-494650f775d0 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:20.792952 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea0cc6-2334-4f9f-97c4-494650f775d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:20.794134 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea0cc6-2334-4f9f-97c4-494650f775d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:20.794993 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea0cc6-2334-4f9f-97c4-494650f775d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:20.795326 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea0cc6-2334-4f9f-97c4-494650f775d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:20.797478 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea0cc6-2334-4f9f-97c4-494650f775d0 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:20.806987 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 92/198] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:13:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:20.808055 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea0cc6-2334-4f9f-97c4-494650f775d0 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:20.829723 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7248b-44e6-43aa-9eec-4f03e715d2ef None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:20.878501 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a91a4-596a-41f2-a9bc-342470693ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:20.879159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a91a4-596a-41f2-a9bc-342470693ad9 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:20.879447 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a91a4-596a-41f2-a9bc-342470693ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:20.879726 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a91a4-596a-41f2-a9bc-342470693ad9 None admin] PATH_INFO: `/v3/users/52beb353a5f0479da28ac6e5cef06318` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:20.880982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a91a4-596a-41f2-a9bc-342470693ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=52beb353a5f0479da28ac6e5cef06318)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:20.882560 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a91a4-596a-41f2-a9bc-342470693ad9 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:20.884626 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 107/199] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:20 2022] GET /identity/v3/users/52beb353a5f0479da28ac6e5cef06318 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:20.887231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a91a4-596a-41f2-a9bc-342470693ad9 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:20.954179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea0cc6-2334-4f9f-97c4-494650f775d0 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:20.957014 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:20.978741 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:21.007815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebf689-d337-4729-ab5a-0c2f5df6b915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:21.007815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebf689-d337-4729-ab5a-0c2f5df6b915 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:21.007815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebf689-d337-4729-ab5a-0c2f5df6b915 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:21.008198 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebf689-d337-4729-ab5a-0c2f5df6b915 None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:21.009815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebf689-d337-4729-ab5a-0c2f5df6b915 None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:21.010805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebf689-d337-4729-ab5a-0c2f5df6b915 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:21.013886 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 93/200] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:20 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:21.014735 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebf689-d337-4729-ab5a-0c2f5df6b915 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:21.053221 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a91a4-596a-41f2-a9bc-342470693ad9 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:21.094973 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19579e-fe64-4b59-af9b-28174893f7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:21.095621 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19579e-fe64-4b59-af9b-28174893f7c7 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:21.095908 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19579e-fe64-4b59-af9b-28174893f7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:21.096566 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19579e-fe64-4b59-af9b-28174893f7c7 None admin] PATH_INFO: `/v3/users/330389040c4347b6b47e22817fa80efc` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:21.097507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19579e-fe64-4b59-af9b-28174893f7c7 None admin] RBAC: Authorizing `identity:get_user(user_id=330389040c4347b6b47e22817fa80efc)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:21.098969 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f19579e-fe64-4b59-af9b-28174893f7c7 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:21.100835 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 108/201] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:20 2022] GET /identity/v3/users/330389040c4347b6b47e22817fa80efc => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:21.101666 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19579e-fe64-4b59-af9b-28174893f7c7 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:21.153735 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebf689-d337-4729-ab5a-0c2f5df6b915 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:21.207825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07d35d-b6b5-418a-83f3-753430afbe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:21.209554 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d35d-b6b5-418a-83f3-753430afbe79 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:21.210015 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d35d-b6b5-418a-83f3-753430afbe79 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:21.210749 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d35d-b6b5-418a-83f3-753430afbe79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:21.219698 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f19579e-fe64-4b59-af9b-28174893f7c7 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:21.249722 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:21.259558 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb9e61-5e23-410c-b2e2-bc71aeced26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:21.260256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb9e61-5e23-410c-b2e2-bc71aeced26c None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:21.260507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb9e61-5e23-410c-b2e2-bc71aeced26c None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:21.260883 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb9e61-5e23-410c-b2e2-bc71aeced26c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:21.261749 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb9e61-5e23-410c-b2e2-bc71aeced26c None admin] RBAC: Adding query filter params (role.id=a1c22a1558c34c1d9d262bf1da31887e, scope.project.id=c68a6eefe1c74e299927c4592703857d, user.id=330389040c4347b6b47e22817fa80efc) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:21.262132 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb9e61-5e23-410c-b2e2-bc71aeced26c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:21.264023 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb9e61-5e23-410c-b2e2-bc71aeced26c None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:21.273088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 109/202] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:21 2022] GET /identity/v3/role_assignments?user.id=330389040c4347b6b47e22817fa80efc&scope.project.id=c68a6eefe1c74e299927c4592703857d&role.id=a1c22a1558c34c1d9d262bf1da31887e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:21.275027 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb9e61-5e23-410c-b2e2-bc71aeced26c None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:21.276993 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:21.326251 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07d35d-b6b5-418a-83f3-753430afbe79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:21.328172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07d35d-b6b5-418a-83f3-753430afbe79 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:21.482198 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb9e61-5e23-410c-b2e2-bc71aeced26c None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:21.508021 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 94/203] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:21.514914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07d35d-b6b5-418a-83f3-753430afbe79 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:21.541937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7d14a-6114-4530-9f9e-affa3f8aa3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:21.542861 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7d14a-6114-4530-9f9e-affa3f8aa3b4 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:21.543461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7d14a-6114-4530-9f9e-affa3f8aa3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:21.544392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7d14a-6114-4530-9f9e-affa3f8aa3b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:21.656438 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:21.680906 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:21.692165 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7d14a-6114-4530-9f9e-affa3f8aa3b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:21.696637 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7d14a-6114-4530-9f9e-affa3f8aa3b4 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:21.721653 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07d35d-b6b5-418a-83f3-753430afbe79 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:21.795084 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dd9f1-8deb-4c12-b7dd-ffd05bd66062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:21.796002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dd9f1-8deb-4c12-b7dd-ffd05bd66062 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:21.797373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dd9f1-8deb-4c12-b7dd-ffd05bd66062 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:21.797825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dd9f1-8deb-4c12-b7dd-ffd05bd66062 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:21.801679 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dd9f1-8deb-4c12-b7dd-ffd05bd66062 None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:21.803364 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dd9f1-8deb-4c12-b7dd-ffd05bd66062 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:21.806478 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 95/204] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:21 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:21.813715 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dd9f1-8deb-4c12-b7dd-ffd05bd66062 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:21.895871 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 110/205] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:21.905686 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7d14a-6114-4530-9f9e-affa3f8aa3b4 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:22.017208 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dd9f1-8deb-4c12-b7dd-ffd05bd66062 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:22.065696 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:22.081105 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a0a1-c5ee-46b0-bced-013b6d0340e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:22.081741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a0a1-c5ee-46b0-bced-013b6d0340e0 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:22.082023 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a0a1-c5ee-46b0-bced-013b6d0340e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:22.082295 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a0a1-c5ee-46b0-bced-013b6d0340e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:22.087274 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a0a1-c5ee-46b0-bced-013b6d0340e0 None admin] RBAC: Adding query filter params (role.id=46aa5e1d5e704ae78369f7707f6977dc, scope.project.id=b54c43bcbc404d39884c37ef65b10c56, user.id=52beb353a5f0479da28ac6e5cef06318) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:22.087274 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a0a1-c5ee-46b0-bced-013b6d0340e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:22.087274 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a0a1-c5ee-46b0-bced-013b6d0340e0 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:22.095888 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7d14a-6114-4530-9f9e-affa3f8aa3b4 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:22.100382 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 96/206] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:21 2022] GET /identity/v3/role_assignments?user.id=52beb353a5f0479da28ac6e5cef06318&scope.project.id=b54c43bcbc404d39884c37ef65b10c56&role.id=46aa5e1d5e704ae78369f7707f6977dc => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:22.159242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017e747-6383-4bb7-80f9-55e1fc24860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:22.160270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017e747-6383-4bb7-80f9-55e1fc24860a None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:22.165020 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017e747-6383-4bb7-80f9-55e1fc24860a None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:22.165703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017e747-6383-4bb7-80f9-55e1fc24860a None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:22.167404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017e747-6383-4bb7-80f9-55e1fc24860a None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:22.169748 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017e747-6383-4bb7-80f9-55e1fc24860a None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:22.171821 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 111/207] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:21 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:22.178008 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a0a1-c5ee-46b0-bced-013b6d0340e0 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:22.184888 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:22.325414 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a0a1-c5ee-46b0-bced-013b6d0340e0 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:22.364318 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d535163-83ae-403f-9e96-90573ba59322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:22.369736 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d535163-83ae-403f-9e96-90573ba59322 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:22.369736 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d535163-83ae-403f-9e96-90573ba59322 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:22.369736 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d535163-83ae-403f-9e96-90573ba59322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:22.369736 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d535163-83ae-403f-9e96-90573ba59322 None admin] RBAC: Adding query filter params (role.id=753aa4902b7544299c8bed1f59c1153e, scope.project.id=c68a6eefe1c74e299927c4592703857d, user.id=330389040c4347b6b47e22817fa80efc) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:22.369736 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d535163-83ae-403f-9e96-90573ba59322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:22.369736 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d535163-83ae-403f-9e96-90573ba59322 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:22.375175 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 97/208] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:22 2022] GET /identity/v3/role_assignments?user.id=330389040c4347b6b47e22817fa80efc&scope.project.id=c68a6eefe1c74e299927c4592703857d&role.id=753aa4902b7544299c8bed1f59c1153e => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:23.253800 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ce3ad-086f-4d0a-bd5d-d62fe2ff9e86 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:23.254311 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ce3ad-086f-4d0a-bd5d-d62fe2ff9e86 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:23.254433 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ce3ad-086f-4d0a-bd5d-d62fe2ff9e86 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:23.255801 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 112/209] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:23.261241 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22159d-7fa0-497f-b3cb-1351bdb835ac None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:23.262077 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22159d-7fa0-497f-b3cb-1351bdb835ac None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:23.262635 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22159d-7fa0-497f-b3cb-1351bdb835ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:23.283585 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-8b22159d-7fa0-497f-b3cb-1351bdb835ac None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:23.285163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-8b22159d-7fa0-497f-b3cb-1351bdb835ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:23.357143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:23.366883 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc0426-e603-4a87-9373-638e3f986a95 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:23.367831 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc0426-e603-4a87-9373-638e3f986a95 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:23.375964 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc0426-e603-4a87-9373-638e3f986a95 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:23.376084 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 98/210] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:13:23.376160 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 113/211] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:23.376227 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6b007-9e1d-408e-8d57-547679e16084 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:23.376641 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6b007-9e1d-408e-8d57-547679e16084 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:23.377126 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6b007-9e1d-408e-8d57-547679e16084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:23.397950 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-84a6b007-9e1d-408e-8d57-547679e16084 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:23.399479 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-84a6b007-9e1d-408e-8d57-547679e16084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:23.475520 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 99/212] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:23.705405 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc0426-e603-4a87-9373-638e3f986a95 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:23.811843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb7fb7-e501-4f47-a07a-d8e60218c288 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:23.812601 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb7fb7-e501-4f47-a07a-d8e60218c288 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:23.813099 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb7fb7-e501-4f47-a07a-d8e60218c288 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:23.814998 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 100/213] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:23.822367 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab7e24-8930-4d96-a241-ee698bee8f14 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:23.823041 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab7e24-8930-4d96-a241-ee698bee8f14 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:23.823557 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab7e24-8930-4d96-a241-ee698bee8f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:23.835190 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc0426-e603-4a87-9373-638e3f986a95 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:23.848104 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-fcab7e24-8930-4d96-a241-ee698bee8f14 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:23.849358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-fcab7e24-8930-4d96-a241-ee698bee8f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:23.876809 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfa666-ea6a-40c0-a2cf-3aeb2917fe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:23.877442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfa666-ea6a-40c0-a2cf-3aeb2917fe1b None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:23.877716 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfa666-ea6a-40c0-a2cf-3aeb2917fe1b None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:23.877987 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfa666-ea6a-40c0-a2cf-3aeb2917fe1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:23.893646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfa666-ea6a-40c0-a2cf-3aeb2917fe1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-e7cfa666-ea6a-40c0-a2cf-3aeb2917fe1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:23.899665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:23.901086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:23.901947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:23.901947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:23.901947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:23.901947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:23.901947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:23.901947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:23.901947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:23.901947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:23.901947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:23.901947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:23.901947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:23.901947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:23.901947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 114/214] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:23.901947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfa666-ea6a-40c0-a2cf-3aeb2917fe1b None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:23.925621 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:23.944734 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 101/215] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:23.945868 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab7e24-8930-4d96-a241-ee698bee8f14 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:24.020188 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfa666-ea6a-40c0-a2cf-3aeb2917fe1b None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:24.033995 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:24.060286 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1e22d-2af2-43f5-ab5b-0682c3318db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:24.061149 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1e22d-2af2-43f5-ab5b-0682c3318db6 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:24.061563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1e22d-2af2-43f5-ab5b-0682c3318db6 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:24.062029 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1e22d-2af2-43f5-ab5b-0682c3318db6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:24.063572 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1e22d-2af2-43f5-ab5b-0682c3318db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:24.065038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1e22d-2af2-43f5-ab5b-0682c3318db6 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:24.066792 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 115/216] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:13:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:24.076577 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1e22d-2af2-43f5-ab5b-0682c3318db6 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:24.095206 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab7e24-8930-4d96-a241-ee698bee8f14 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:24.135823 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9458c-29c8-463d-a180-234cdcb1d8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:24.136596 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9458c-29c8-463d-a180-234cdcb1d8b0 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:24.137787 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9458c-29c8-463d-a180-234cdcb1d8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:24.138399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9458c-29c8-463d-a180-234cdcb1d8b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:24.138616 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9458c-29c8-463d-a180-234cdcb1d8b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:24.138924 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9458c-29c8-463d-a180-234cdcb1d8b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:24.140333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9458c-29c8-463d-a180-234cdcb1d8b0 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:24.155411 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 102/217] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:24.156482 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9458c-29c8-463d-a180-234cdcb1d8b0 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:24.203241 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:24.225152 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1e22d-2af2-43f5-ab5b-0682c3318db6 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:24.274798 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9458c-29c8-463d-a180-234cdcb1d8b0 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:24.280196 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870c805-60a1-4f10-a01d-67669ca0c690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:24.281411 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870c805-60a1-4f10-a01d-67669ca0c690 None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:24.282047 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870c805-60a1-4f10-a01d-67669ca0c690 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:24.282522 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870c805-60a1-4f10-a01d-67669ca0c690 None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:24.283438 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870c805-60a1-4f10-a01d-67669ca0c690 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:24.285620 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870c805-60a1-4f10-a01d-67669ca0c690 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:24.295945 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:24.314248 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6ab3d-1c6b-4f7c-a092-f83540d6a8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:24.314882 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6ab3d-1c6b-4f7c-a092-f83540d6a8b1 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:24.315159 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6ab3d-1c6b-4f7c-a092-f83540d6a8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:24.315431 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6ab3d-1c6b-4f7c-a092-f83540d6a8b1 None admin] PATH_INFO: `/v3/users/ad7c6e872a854f4d9453f710757976d5` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:24.330179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6ab3d-1c6b-4f7c-a092-f83540d6a8b1 None admin] RBAC: Authorizing `identity:get_user(user_id=ad7c6e872a854f4d9453f710757976d5)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:24.331748 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6ab3d-1c6b-4f7c-a092-f83540d6a8b1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:24.333439 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 103/218] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:24 2022] GET /identity/v3/users/ad7c6e872a854f4d9453f710757976d5 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:24.334195 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6ab3d-1c6b-4f7c-a092-f83540d6a8b1 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:24.408737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 116/219] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Sep 3 21:13:24 2022] POST /identity/v3/users => generated 297 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:13:24.410026 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870c805-60a1-4f10-a01d-67669ca0c690 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:24.451737 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6ab3d-1c6b-4f7c-a092-f83540d6a8b1 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:24.495622 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab3a2f-799f-4b52-8c8e-091a2f0fc7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:24.497140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab3a2f-799f-4b52-8c8e-091a2f0fc7cf None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:24.497593 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab3a2f-799f-4b52-8c8e-091a2f0fc7cf None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:24.498060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab3a2f-799f-4b52-8c8e-091a2f0fc7cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:24.511295 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab3a2f-799f-4b52-8c8e-091a2f0fc7cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-13ab3a2f-799f-4b52-8c8e-091a2f0fc7cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:24.518420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:24.519600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:24.520561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:24.520561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:24.520561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:24.520561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:24.520561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:24.520561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:24.520561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:24.520561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:24.520561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:24.520561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:24.520561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:24.520561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:24.528764 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 104/220] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:13:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:24.530054 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab3a2f-799f-4b52-8c8e-091a2f0fc7cf None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:24.556477 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870c805-60a1-4f10-a01d-67669ca0c690 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:24.587381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:24.600742 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d86397-f238-460d-ac58-050379832360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:24.604697 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d86397-f238-460d-ac58-050379832360 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:24.604697 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d86397-f238-460d-ac58-050379832360 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:24.604697 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d86397-f238-460d-ac58-050379832360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:24.618693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:24.680329 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab3a2f-799f-4b52-8c8e-091a2f0fc7cf None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:24.701000 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d86397-f238-460d-ac58-050379832360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:24.702842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d86397-f238-460d-ac58-050379832360 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:24.720056 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88b527-eeed-4f52-8d79-5a3cc95976ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:24.720895 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88b527-eeed-4f52-8d79-5a3cc95976ec None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:24.721006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88b527-eeed-4f52-8d79-5a3cc95976ec None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:24.721244 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88b527-eeed-4f52-8d79-5a3cc95976ec None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:24.721921 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88b527-eeed-4f52-8d79-5a3cc95976ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:24.722224 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88b527-eeed-4f52-8d79-5a3cc95976ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:24.723659 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88b527-eeed-4f52-8d79-5a3cc95976ec None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:24.736121 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 105/221] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:24.737292 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b3c26-f2f4-4b50-a641-a94c8e682026 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:24.737581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b3c26-f2f4-4b50-a641-a94c8e682026 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:24.737860 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b3c26-f2f4-4b50-a641-a94c8e682026 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:24.739254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 106/222] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:24.743951 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b3c26-f2f4-4b50-a641-a94c8e682026 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:24.857056 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 117/223] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:24.858250 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec2eae-5a21-4f0f-afba-333681b954b7 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:24.858778 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec2eae-5a21-4f0f-afba-333681b954b7 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:24.859053 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec2eae-5a21-4f0f-afba-333681b954b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:24.879462 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-dcec2eae-5a21-4f0f-afba-333681b954b7 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:24.880676 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-dcec2eae-5a21-4f0f-afba-333681b954b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:24.893018 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:24.899822 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b3c26-f2f4-4b50-a641-a94c8e682026 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:24.919533 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:24.944154 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e760ab-c435-4102-a5a1-b41777a2893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:24.945069 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e760ab-c435-4102-a5a1-b41777a2893b None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:24.945516 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e760ab-c435-4102-a5a1-b41777a2893b None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:24.945928 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e760ab-c435-4102-a5a1-b41777a2893b None admin] PATH_INFO: `/v3/users/330389040c4347b6b47e22817fa80efc` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:24.947533 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e760ab-c435-4102-a5a1-b41777a2893b None admin] RBAC: Authorizing `identity:get_user(user_id=330389040c4347b6b47e22817fa80efc)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:24.949698 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e760ab-c435-4102-a5a1-b41777a2893b None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:24.952485 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 107/224] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:24 2022] GET /identity/v3/users/330389040c4347b6b47e22817fa80efc => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:24.953723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e760ab-c435-4102-a5a1-b41777a2893b None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:24.983181 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 118/225] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:24.985113 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec2eae-5a21-4f0f-afba-333681b954b7 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:25.083730 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e760ab-c435-4102-a5a1-b41777a2893b None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:25.126660 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf84dc-4991-4db9-b0e7-e3e130a35029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:25.127795 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf84dc-4991-4db9-b0e7-e3e130a35029 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:25.128273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf84dc-4991-4db9-b0e7-e3e130a35029 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:25.128790 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf84dc-4991-4db9-b0e7-e3e130a35029 None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:25.130454 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf84dc-4991-4db9-b0e7-e3e130a35029 None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:25.132392 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf84dc-4991-4db9-b0e7-e3e130a35029 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:25.134824 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 108/226] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:24 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:25.141296 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf84dc-4991-4db9-b0e7-e3e130a35029 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:25.192420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:25.225532 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec2eae-5a21-4f0f-afba-333681b954b7 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:25.274801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf84dc-4991-4db9-b0e7-e3e130a35029 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:25.339879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89359d54-9768-4e3d-8975-200c1468c76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:25.341587 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89359d54-9768-4e3d-8975-200c1468c76d None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:25.342100 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89359d54-9768-4e3d-8975-200c1468c76d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:25.343013 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89359d54-9768-4e3d-8975-200c1468c76d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:25.344294 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89359d54-9768-4e3d-8975-200c1468c76d None admin] RBAC: Adding query filter params (role.id=b7001437cbb84adc825e214c44d6e551, scope.project.id=c68a6eefe1c74e299927c4592703857d, user.id=ad7c6e872a854f4d9453f710757976d5) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:25.345325 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89359d54-9768-4e3d-8975-200c1468c76d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:25.346128 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796f4fb-d501-4459-8a7f-9c012fd48ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:25.348206 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89359d54-9768-4e3d-8975-200c1468c76d None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:25.354504 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796f4fb-d501-4459-8a7f-9c012fd48ce4 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:25.354504 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796f4fb-d501-4459-8a7f-9c012fd48ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:25.354504 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796f4fb-d501-4459-8a7f-9c012fd48ce4 None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:25.355986 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796f4fb-d501-4459-8a7f-9c012fd48ce4 None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:25.357734 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796f4fb-d501-4459-8a7f-9c012fd48ce4 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:25.359918 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 119/227] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:24 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:25.369752 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 109/228] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:25 2022] GET /identity/v3/role_assignments?user.id=ad7c6e872a854f4d9453f710757976d5&scope.project.id=c68a6eefe1c74e299927c4592703857d&role.id=b7001437cbb84adc825e214c44d6e551 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:25.371564 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796f4fb-d501-4459-8a7f-9c012fd48ce4 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:25.413982 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89359d54-9768-4e3d-8975-200c1468c76d None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:25.522859 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:25.711206 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:25.717420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89359d54-9768-4e3d-8975-200c1468c76d None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:25.720821 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796f4fb-d501-4459-8a7f-9c012fd48ce4 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:25.788349 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e3026-65d5-4aa7-81fc-974fa621167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:25.789027 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e3026-65d5-4aa7-81fc-974fa621167d None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:25.789306 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e3026-65d5-4aa7-81fc-974fa621167d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:25.789579 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e3026-65d5-4aa7-81fc-974fa621167d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:25.797797 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13395ef3-ab93-45d2-a557-663e33906dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:25.798480 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13395ef3-ab93-45d2-a557-663e33906dab None admin] REQUEST_METHOD: `PUT` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:25.798757 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13395ef3-ab93-45d2-a557-663e33906dab None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:25.799029 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13395ef3-ab93-45d2-a557-663e33906dab None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d/users/330389040c4347b6b47e22817fa80efc/roles/a1c22a1558c34c1d9d262bf1da31887e` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:25.801796 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13395ef3-ab93-45d2-a557-663e33906dab None admin] RBAC: Authorizing `identity:create_grant(project_id=c68a6eefe1c74e299927c4592703857d, user_id=330389040c4347b6b47e22817fa80efc, role_id=a1c22a1558c34c1d9d262bf1da31887e)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:25.803289 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13395ef3-ab93-45d2-a557-663e33906dab None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:25.808105 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e3026-65d5-4aa7-81fc-974fa621167d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-869e3026-65d5-4aa7-81fc-974fa621167d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:25.814879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:25.815990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:25.817060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:25.817060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:25.817060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:25.817060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:25.817060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:25.817060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:25.817060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:25.817060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:25.817060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:25.817060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:25.817060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:25.817060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:25.819388 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 110/229] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:13:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:13:25.825483 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e3026-65d5-4aa7-81fc-974fa621167d None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:25.904548 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 120/230] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:13:25 2022] PUT /identity/v3/projects/c68a6eefe1c74e299927c4592703857d/users/330389040c4347b6b47e22817fa80efc/roles/a1c22a1558c34c1d9d262bf1da31887e => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:13:25.939849 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e3026-65d5-4aa7-81fc-974fa621167d None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:25.993688 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabab86-1a86-4292-a918-91541dcde354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:25.994534 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabab86-1a86-4292-a918-91541dcde354 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:25.994959 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabab86-1a86-4292-a918-91541dcde354 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:25.995374 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabab86-1a86-4292-a918-91541dcde354 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:25.997036 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabab86-1a86-4292-a918-91541dcde354 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:25.997518 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabab86-1a86-4292-a918-91541dcde354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:25.999074 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabab86-1a86-4292-a918-91541dcde354 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:26.013303 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 111/231] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:13:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:26.019441 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13395ef3-ab93-45d2-a557-663e33906dab None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:26.188115 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:26.191571 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13395ef3-ab93-45d2-a557-663e33906dab None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:26.233816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d663-04f0-4d1c-998e-65975649ed98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:26.234457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d663-04f0-4d1c-998e-65975649ed98 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:26.234733 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d663-04f0-4d1c-998e-65975649ed98 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:26.235031 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d663-04f0-4d1c-998e-65975649ed98 None admin] PATH_INFO: `/v3/users/330389040c4347b6b47e22817fa80efc` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:26.236157 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9d663-04f0-4d1c-998e-65975649ed98 None admin] RBAC: Authorizing `identity:get_user(user_id=330389040c4347b6b47e22817fa80efc)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:26.237691 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9d663-04f0-4d1c-998e-65975649ed98 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:26.239899 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 121/232] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:26 2022] GET /identity/v3/users/330389040c4347b6b47e22817fa80efc => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:26.245311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabab86-1a86-4292-a918-91541dcde354 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:26.280254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:26.397864 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabab86-1a86-4292-a918-91541dcde354 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:26.450014 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b642f-53bf-4b09-a2b1-85ae986e00fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:26.450672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b642f-53bf-4b09-a2b1-85ae986e00fe None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:26.450953 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b642f-53bf-4b09-a2b1-85ae986e00fe None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:26.451228 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b642f-53bf-4b09-a2b1-85ae986e00fe None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:26.452422 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b642f-53bf-4b09-a2b1-85ae986e00fe None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:26.453942 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b642f-53bf-4b09-a2b1-85ae986e00fe None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:26.455912 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 112/233] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:26 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:26.461827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d663-04f0-4d1c-998e-65975649ed98 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:26.607079 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d663-04f0-4d1c-998e-65975649ed98 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:26.652088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523138c-65e1-4552-8b16-f195cc7102e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:26.653687 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523138c-65e1-4552-8b16-f195cc7102e8 None admin] REQUEST_METHOD: `PUT` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:26.653987 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523138c-65e1-4552-8b16-f195cc7102e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:26.654263 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523138c-65e1-4552-8b16-f195cc7102e8 None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d/users/330389040c4347b6b47e22817fa80efc/roles/753aa4902b7544299c8bed1f59c1153e` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:26.656593 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523138c-65e1-4552-8b16-f195cc7102e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c68a6eefe1c74e299927c4592703857d, user_id=330389040c4347b6b47e22817fa80efc, role_id=753aa4902b7544299c8bed1f59c1153e)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:26.658175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523138c-65e1-4552-8b16-f195cc7102e8 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:26.751930 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 122/234] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:13:26 2022] PUT /identity/v3/projects/c68a6eefe1c74e299927c4592703857d/users/330389040c4347b6b47e22817fa80efc/roles/753aa4902b7544299c8bed1f59c1153e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:13:27.202676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128faea-a3f5-4434-906d-bc69e1cce97f None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:27.203062 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128faea-a3f5-4434-906d-bc69e1cce97f None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:27.203241 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128faea-a3f5-4434-906d-bc69e1cce97f None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:27.204913 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 113/235] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:27.210849 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50787411-e5d7-40c7-b1b2-c752311fbc3b None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:27.211128 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50787411-e5d7-40c7-b1b2-c752311fbc3b None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:27.211398 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50787411-e5d7-40c7-b1b2-c752311fbc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:27.241638 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-50787411-e5d7-40c7-b1b2-c752311fbc3b None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:27.242845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-50787411-e5d7-40c7-b1b2-c752311fbc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:27.274059 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:27.303535 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ee4e8-a87f-4087-9a38-d4d5b9045464 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:27.304561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ee4e8-a87f-4087-9a38-d4d5b9045464 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:27.305047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ee4e8-a87f-4087-9a38-d4d5b9045464 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:27.309391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 114/236] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:13:27.314190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d74882-26c2-445b-a883-0c3676247754 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:27.314879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d74882-26c2-445b-a883-0c3676247754 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:27.315364 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d74882-26c2-445b-a883-0c3676247754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:27.345368 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-c4d74882-26c2-445b-a883-0c3676247754 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:27.346632 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-c4d74882-26c2-445b-a883-0c3676247754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:27.352770 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 123/237] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:27.429721 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 115/238] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:27.800177 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50787411-e5d7-40c7-b1b2-c752311fbc3b None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:27.857192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d74882-26c2-445b-a883-0c3676247754 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:27.885467 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:28.007010 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50787411-e5d7-40c7-b1b2-c752311fbc3b None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:28.026334 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d74882-26c2-445b-a883-0c3676247754 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:28.048391 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564287c-3a1e-4a23-b20b-87233011e05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:28.049067 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564287c-3a1e-4a23-b20b-87233011e05f None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:28.049351 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564287c-3a1e-4a23-b20b-87233011e05f None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:28.049626 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564287c-3a1e-4a23-b20b-87233011e05f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:28.061111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564287c-3a1e-4a23-b20b-87233011e05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-9564287c-3a1e-4a23-b20b-87233011e05f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:28.066270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:28.067147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:28.067947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:28.067947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:28.067947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:28.067947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:28.067947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:28.067947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:28.067947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:28.067947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:28.067947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:28.067947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:28.067947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:28.067947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:28.067947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 124/239] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:28.069097 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340f697-cd15-4ec1-975f-96cae345ea2e None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:28.069192 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340f697-cd15-4ec1-975f-96cae345ea2e None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:28.069434 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340f697-cd15-4ec1-975f-96cae345ea2e None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:28.069954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a0d47-5a0b-449d-a853-26d0c885c5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:28.070808 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 125/240] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:28.071229 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a0d47-5a0b-449d-a853-26d0c885c5c6 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:28.071704 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a0d47-5a0b-449d-a853-26d0c885c5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:28.072173 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a0d47-5a0b-449d-a853-26d0c885c5c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:28.073762 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a0d47-5a0b-449d-a853-26d0c885c5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:28.076139 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340f697-cd15-4ec1-975f-96cae345ea2e None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:28.081878 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a0d47-5a0b-449d-a853-26d0c885c5c6 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:28.083924 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 116/241] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:13:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:28.085553 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced513-c192-4b37-8545-d3d44d1ddb02 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:28.086074 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced513-c192-4b37-8545-d3d44d1ddb02 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:28.086549 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced513-c192-4b37-8545-d3d44d1ddb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:28.097205 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:28.109817 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-99ced513-c192-4b37-8545-d3d44d1ddb02 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:28.111277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-99ced513-c192-4b37-8545-d3d44d1ddb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:28.184261 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340f697-cd15-4ec1-975f-96cae345ea2e None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:28.188050 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 117/242] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:28.189172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ced513-c192-4b37-8545-d3d44d1ddb02 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:28.229176 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:28.255838 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774482b-3894-456e-b796-7187ce1e497b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:28.256880 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774482b-3894-456e-b796-7187ce1e497b None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:28.257390 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774482b-3894-456e-b796-7187ce1e497b None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:28.259251 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9774482b-3894-456e-b796-7187ce1e497b None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:28.263312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774482b-3894-456e-b796-7187ce1e497b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:28.263871 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774482b-3894-456e-b796-7187ce1e497b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:28.265610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9774482b-3894-456e-b796-7187ce1e497b None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:28.282149 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 126/243] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:28.287925 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774482b-3894-456e-b796-7187ce1e497b None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:28.391643 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:28.400509 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ced513-c192-4b37-8545-d3d44d1ddb02 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:28.415101 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9774482b-3894-456e-b796-7187ce1e497b None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:28.459193 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005d5d3-2d13-4543-ae82-82ff70584ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:28.460368 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d5d3-2d13-4543-ae82-82ff70584ffc None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:28.460934 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d5d3-2d13-4543-ae82-82ff70584ffc None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:28.461405 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005d5d3-2d13-4543-ae82-82ff70584ffc None admin] PATH_INFO: `/v3/users/a196b889e2c340b99ca12c745cfa0c24` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:28.476999 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005d5d3-2d13-4543-ae82-82ff70584ffc None admin] RBAC: Authorizing `identity:get_user(user_id=a196b889e2c340b99ca12c745cfa0c24)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:28.478171 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3c146-dbf4-468b-ab70-33b853f529b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:28.478795 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3c146-dbf4-468b-ab70-33b853f529b0 None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:28.479071 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3c146-dbf4-468b-ab70-33b853f529b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:28.479340 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3c146-dbf4-468b-ab70-33b853f529b0 None admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:28.479692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005d5d3-2d13-4543-ae82-82ff70584ffc None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:28.479992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3c146-dbf4-468b-ab70-33b853f529b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:28.481498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3c146-dbf4-468b-ab70-33b853f529b0 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:28.482618 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 127/244] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:28 2022] GET /identity/v3/users/a196b889e2c340b99ca12c745cfa0c24 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:28.488556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005d5d3-2d13-4543-ae82-82ff70584ffc None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:28.591701 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 118/245] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Sep 3 21:13:28 2022] POST /identity/v3/users => generated 293 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:13:28.599485 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005d5d3-2d13-4543-ae82-82ff70584ffc None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:28.643024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee128c4-4119-4e6b-af85-5800b2ee4a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:28.644107 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee128c4-4119-4e6b-af85-5800b2ee4a01 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:28.644631 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee128c4-4119-4e6b-af85-5800b2ee4a01 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:28.645202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee128c4-4119-4e6b-af85-5800b2ee4a01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:28.653630 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3c146-dbf4-468b-ab70-33b853f529b0 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:28.655893 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:28.727435 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee128c4-4119-4e6b-af85-5800b2ee4a01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:28.729770 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee128c4-4119-4e6b-af85-5800b2ee4a01 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:28.811041 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:28.924645 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3c146-dbf4-468b-ab70-33b853f529b0 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:28.976092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df02c0c-64e8-4d5f-b67f-8eb74deec72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:28.977367 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df02c0c-64e8-4d5f-b67f-8eb74deec72f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:28.977874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df02c0c-64e8-4d5f-b67f-8eb74deec72f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:28.978619 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df02c0c-64e8-4d5f-b67f-8eb74deec72f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:28.985461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 128/246] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:28.992216 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee128c4-4119-4e6b-af85-5800b2ee4a01 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:29.001392 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df02c0c-64e8-4d5f-b67f-8eb74deec72f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-8df02c0c-64e8-4d5f-b67f-8eb74deec72f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:29.013194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:29.014275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:29.015097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:29.015097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:29.015097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:29.015097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:29.015097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:29.015097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:29.015097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:29.015097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:29.015097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:29.015097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:29.015097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:29.015097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:29.021468 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 119/247] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:29.023689 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3fa21-dca8-4ee5-9197-1080dc0f0128 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:29.023689 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3fa21-dca8-4ee5-9197-1080dc0f0128 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:29.023689 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3fa21-dca8-4ee5-9197-1080dc0f0128 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:29.025282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 120/248] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:29.025790 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3fa21-dca8-4ee5-9197-1080dc0f0128 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:29.068667 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:29.156337 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee128c4-4119-4e6b-af85-5800b2ee4a01 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:29.172250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3fa21-dca8-4ee5-9197-1080dc0f0128 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:29.206993 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:29.208445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843f85f-4807-4c3c-94df-f15b90919bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:29.209478 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843f85f-4807-4c3c-94df-f15b90919bda None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:29.210061 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843f85f-4807-4c3c-94df-f15b90919bda None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:29.210479 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843f85f-4807-4c3c-94df-f15b90919bda None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:29.212241 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843f85f-4807-4c3c-94df-f15b90919bda None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:29.213479 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728a585-f40e-4f33-bd1b-36ab0d5d9d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:29.214185 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728a585-f40e-4f33-bd1b-36ab0d5d9d59 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:29.214491 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843f85f-4807-4c3c-94df-f15b90919bda None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:29.214629 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728a585-f40e-4f33-bd1b-36ab0d5d9d59 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:29.215118 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728a585-f40e-4f33-bd1b-36ab0d5d9d59 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:29.218017 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728a585-f40e-4f33-bd1b-36ab0d5d9d59 None admin] RBAC: Adding query filter params (name=member) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:29.218017 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728a585-f40e-4f33-bd1b-36ab0d5d9d59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:29.218197 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 129/249] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:28 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:29.218197 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba22a4-5ef4-4d0f-9966-4f91989365ab None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:29.218448 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728a585-f40e-4f33-bd1b-36ab0d5d9d59 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:29.218795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba22a4-5ef4-4d0f-9966-4f91989365ab None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:29.219201 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba22a4-5ef4-4d0f-9966-4f91989365ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:29.233587 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 121/250] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:29.234672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728a585-f40e-4f33-bd1b-36ab0d5d9d59 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:29.242532 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-55ba22a4-5ef4-4d0f-9966-4f91989365ab None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:29.244025 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-55ba22a4-5ef4-4d0f-9966-4f91989365ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:29.344181 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 130/251] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:29.345956 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba22a4-5ef4-4d0f-9966-4f91989365ab None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:29.351544 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728a585-f40e-4f33-bd1b-36ab0d5d9d59 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:29.394393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:29.422676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb7da-2b02-4607-b5dd-511737056f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:29.425378 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb7da-2b02-4607-b5dd-511737056f70 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:29.426070 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb7da-2b02-4607-b5dd-511737056f70 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:29.426960 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb7da-2b02-4607-b5dd-511737056f70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:29.429294 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bb7da-2b02-4607-b5dd-511737056f70 None admin] RBAC: Adding query filter params (role.id=46aa5e1d5e704ae78369f7707f6977dc, scope.project.id=c68a6eefe1c74e299927c4592703857d, user.id=a196b889e2c340b99ca12c745cfa0c24) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:29.430095 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bb7da-2b02-4607-b5dd-511737056f70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:29.434550 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bb7da-2b02-4607-b5dd-511737056f70 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:29.447247 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 122/252] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:29 2022] GET /identity/v3/role_assignments?user.id=a196b889e2c340b99ca12c745cfa0c24&scope.project.id=c68a6eefe1c74e299927c4592703857d&role.id=46aa5e1d5e704ae78369f7707f6977dc => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:29.483284 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba22a4-5ef4-4d0f-9966-4f91989365ab None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:29.524408 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851aaba2-7077-4cf8-8b82-dc1c82ac7cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:29.525144 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aaba2-7077-4cf8-8b82-dc1c82ac7cf2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:29.525426 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aaba2-7077-4cf8-8b82-dc1c82ac7cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:29.525745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851aaba2-7077-4cf8-8b82-dc1c82ac7cf2 None admin] PATH_INFO: `/v3/users/ad7c6e872a854f4d9453f710757976d5` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:29.526930 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851aaba2-7077-4cf8-8b82-dc1c82ac7cf2 None admin] RBAC: Authorizing `identity:get_user(user_id=ad7c6e872a854f4d9453f710757976d5)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:29.528983 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851aaba2-7077-4cf8-8b82-dc1c82ac7cf2 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:29.531066 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 131/253] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:29 2022] GET /identity/v3/users/ad7c6e872a854f4d9453f710757976d5 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:29.536309 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb7da-2b02-4607-b5dd-511737056f70 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:29.632442 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:29.693816 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb7da-2b02-4607-b5dd-511737056f70 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:29.718981 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a27c4d-b59b-4e5c-bfb9-37171546dd00 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:29.719327 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a27c4d-b59b-4e5c-bfb9-37171546dd00 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:29.719525 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a27c4d-b59b-4e5c-bfb9-37171546dd00 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:29.721205 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 132/254] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:13:29.728299 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43504fba-c71b-4bf0-94a6-57fc84a3b741 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:29.728602 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43504fba-c71b-4bf0-94a6-57fc84a3b741 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:29.729078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43504fba-c71b-4bf0-94a6-57fc84a3b741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:29.742628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b6fd2-5bd0-4060-9c35-8eef62e63c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:29.743575 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b6fd2-5bd0-4060-9c35-8eef62e63c22 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:29.746493 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b6fd2-5bd0-4060-9c35-8eef62e63c22 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:29.747282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b6fd2-5bd0-4060-9c35-8eef62e63c22 None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:29.753666 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b6fd2-5bd0-4060-9c35-8eef62e63c22 None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:29.755414 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b6fd2-5bd0-4060-9c35-8eef62e63c22 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:29.758909 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 123/255] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:29 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:29.768356 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b6fd2-5bd0-4060-9c35-8eef62e63c22 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:29.775403 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-43504fba-c71b-4bf0-94a6-57fc84a3b741 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:29.778577 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-43504fba-c71b-4bf0-94a6-57fc84a3b741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:29.908048 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 133/256] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:29.914329 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43504fba-c71b-4bf0-94a6-57fc84a3b741 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:30.020436 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:30.035252 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b6fd2-5bd0-4060-9c35-8eef62e63c22 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:30.108915 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:30.139130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ba765-91d6-4762-8fa3-f235426e160d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:30.139813 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ba765-91d6-4762-8fa3-f235426e160d None admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:30.140096 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ba765-91d6-4762-8fa3-f235426e160d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:30.140373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ba765-91d6-4762-8fa3-f235426e160d None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d/users/ad7c6e872a854f4d9453f710757976d5/roles/b7001437cbb84adc825e214c44d6e551` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:30.145912 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ba765-91d6-4762-8fa3-f235426e160d None admin] RBAC: Authorizing `identity:create_grant(project_id=c68a6eefe1c74e299927c4592703857d, user_id=ad7c6e872a854f4d9453f710757976d5, role_id=b7001437cbb84adc825e214c44d6e551)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:30.147667 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ba765-91d6-4762-8fa3-f235426e160d None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:30.180479 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43504fba-c71b-4bf0-94a6-57fc84a3b741 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:30.220839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e540b6-3b24-41eb-9301-20eb604818ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:30.221481 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e540b6-3b24-41eb-9301-20eb604818ea None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:30.221764 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e540b6-3b24-41eb-9301-20eb604818ea None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:30.222038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e540b6-3b24-41eb-9301-20eb604818ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:30.233363 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e540b6-3b24-41eb-9301-20eb604818ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-75e540b6-3b24-41eb-9301-20eb604818ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:30.238445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:30.239395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:30.240173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:30.240173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:30.240173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:30.240173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:30.240173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:30.240173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:30.240173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:30.240173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:30.240173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:30.240173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:30.240173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:30.240173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:30.240173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 134/257] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:13:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:30.245501 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e540b6-3b24-41eb-9301-20eb604818ea None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:30.250757 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 124/258] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:13:29 2022] PUT /identity/v3/projects/c68a6eefe1c74e299927c4592703857d/users/ad7c6e872a854f4d9453f710757976d5/roles/b7001437cbb84adc825e214c44d6e551 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:13:30.377730 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:30.385154 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e540b6-3b24-41eb-9301-20eb604818ea None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:30.394758 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ba765-91d6-4762-8fa3-f235426e160d None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:30.459799 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943044db-bdfb-4093-9c8a-3df412cfd303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:30.460428 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943044db-bdfb-4093-9c8a-3df412cfd303 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:30.460811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943044db-bdfb-4093-9c8a-3df412cfd303 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:30.461086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943044db-bdfb-4093-9c8a-3df412cfd303 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:30.461767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943044db-bdfb-4093-9c8a-3df412cfd303 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:30.462073 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943044db-bdfb-4093-9c8a-3df412cfd303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:30.463505 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943044db-bdfb-4093-9c8a-3df412cfd303 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:30.482925 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 135/259] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:30.489491 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943044db-bdfb-4093-9c8a-3df412cfd303 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:30.614008 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ba765-91d6-4762-8fa3-f235426e160d None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:30.698332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21502c3-9406-41ae-8640-699292e9fa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:30.699098 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21502c3-9406-41ae-8640-699292e9fa65 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:30.699489 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21502c3-9406-41ae-8640-699292e9fa65 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:30.699774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21502c3-9406-41ae-8640-699292e9fa65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:30.708366 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943044db-bdfb-4093-9c8a-3df412cfd303 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:30.716983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21502c3-9406-41ae-8640-699292e9fa65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-b21502c3-9406-41ae-8640-699292e9fa65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:30.727685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:30.728729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:30.729531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:30.729531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:30.729531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:30.729531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:30.729531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:30.729531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:30.729531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:30.729531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:30.729531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:30.729531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:30.729531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:30.729531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:30.733275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 125/260] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:13:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:30.738694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21502c3-9406-41ae-8640-699292e9fa65 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:30.748173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349b43a-2057-4d07-b298-b2b99e318c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:30.751078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b43a-2057-4d07-b298-b2b99e318c40 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:30.751078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b43a-2057-4d07-b298-b2b99e318c40 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:30.751078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b43a-2057-4d07-b298-b2b99e318c40 None admin] PATH_INFO: `/v3/users/330389040c4347b6b47e22817fa80efc` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:30.751078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349b43a-2057-4d07-b298-b2b99e318c40 None admin] RBAC: Authorizing `identity:get_user(user_id=330389040c4347b6b47e22817fa80efc)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:30.752288 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349b43a-2057-4d07-b298-b2b99e318c40 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:30.753995 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 136/261] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:30 2022] GET /identity/v3/users/330389040c4347b6b47e22817fa80efc => generated 283 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:30.764560 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349b43a-2057-4d07-b298-b2b99e318c40 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:30.789536 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:30.808962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:30.927761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21502c3-9406-41ae-8640-699292e9fa65 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:30.970347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c1076-74fc-4226-b72d-1290add1fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:30.972317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c1076-74fc-4226-b72d-1290add1fc03 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:30.972989 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c1076-74fc-4226-b72d-1290add1fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:30.974747 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c1076-74fc-4226-b72d-1290add1fc03 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:30.975677 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c1076-74fc-4226-b72d-1290add1fc03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:30.976386 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c1076-74fc-4226-b72d-1290add1fc03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:30.978808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c1076-74fc-4226-b72d-1290add1fc03 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:31.002556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 126/262] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:13:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:31.004513 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c1076-74fc-4226-b72d-1290add1fc03 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:31.024193 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349b43a-2057-4d07-b298-b2b99e318c40 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:31.109413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b08d75-e608-4ffb-8987-95fcc9a7a9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:31.110077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b08d75-e608-4ffb-8987-95fcc9a7a9af None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:31.110364 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b08d75-e608-4ffb-8987-95fcc9a7a9af None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:31.110635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b08d75-e608-4ffb-8987-95fcc9a7a9af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:31.240193 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c1076-74fc-4226-b72d-1290add1fc03 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:31.254943 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b08d75-e608-4ffb-8987-95fcc9a7a9af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:31.256620 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b08d75-e608-4ffb-8987-95fcc9a7a9af None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:31.268425 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:31.314725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:31.339175 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1f6f2-a640-46ac-a685-c08d29f78374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:31.339860 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1f6f2-a640-46ac-a685-c08d29f78374 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:31.340139 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1f6f2-a640-46ac-a685-c08d29f78374 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:31.340409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1f6f2-a640-46ac-a685-c08d29f78374 None admin] PATH_INFO: `/v3/users/330389040c4347b6b47e22817fa80efc` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:31.344770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1f6f2-a640-46ac-a685-c08d29f78374 None admin] RBAC: Authorizing `identity:get_user(user_id=330389040c4347b6b47e22817fa80efc)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:31.346444 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1f6f2-a640-46ac-a685-c08d29f78374 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:31.348249 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 127/263] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:31 2022] GET /identity/v3/users/330389040c4347b6b47e22817fa80efc => generated 283 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:31.354324 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1f6f2-a640-46ac-a685-c08d29f78374 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:31.469870 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 137/264] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 21:13:31.475833 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b08d75-e608-4ffb-8987-95fcc9a7a9af None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:31.517474 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1f6f2-a640-46ac-a685-c08d29f78374 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:31.593254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f16fa-bffd-4eb4-b14a-dea601cdd7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:31.593863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f16fa-bffd-4eb4-b14a-dea601cdd7ab None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:31.594142 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f16fa-bffd-4eb4-b14a-dea601cdd7ab None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:31.594414 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f16fa-bffd-4eb4-b14a-dea601cdd7ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:31.653619 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:31.655035 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b08d75-e608-4ffb-8987-95fcc9a7a9af None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:31.681717 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f16fa-bffd-4eb4-b14a-dea601cdd7ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:31.683260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f16fa-bffd-4eb4-b14a-dea601cdd7ab None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:31.697303 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:31.717270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f093414-e378-4289-bbb9-9eda5bf7e1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:31.717929 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f093414-e378-4289-bbb9-9eda5bf7e1d1 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:31.718216 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f093414-e378-4289-bbb9-9eda5bf7e1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:31.718495 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f093414-e378-4289-bbb9-9eda5bf7e1d1 None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:31.719734 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f093414-e378-4289-bbb9-9eda5bf7e1d1 None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:31.721289 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f093414-e378-4289-bbb9-9eda5bf7e1d1 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:31.723271 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 138/265] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:31 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:31.729131 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f093414-e378-4289-bbb9-9eda5bf7e1d1 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:31.848227 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 128/266] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 21:13:31.870492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f16fa-bffd-4eb4-b14a-dea601cdd7ab None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:31.983062 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f093414-e378-4289-bbb9-9eda5bf7e1d1 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:32.000926 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:32.029052 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f16fa-bffd-4eb4-b14a-dea601cdd7ab None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:32.046266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdce09-24db-4559-86e1-471cc13f8fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:32.047465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdce09-24db-4559-86e1-471cc13f8fa2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:32.047928 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdce09-24db-4559-86e1-471cc13f8fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:32.048351 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdce09-24db-4559-86e1-471cc13f8fa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:32.049256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdce09-24db-4559-86e1-471cc13f8fa2 None admin] RBAC: Adding query filter params (role.id=a1c22a1558c34c1d9d262bf1da31887e, scope.project.id=c68a6eefe1c74e299927c4592703857d, user.id=330389040c4347b6b47e22817fa80efc) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:32.049717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdce09-24db-4559-86e1-471cc13f8fa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:32.051334 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdce09-24db-4559-86e1-471cc13f8fa2 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:32.063107 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 139/267] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:31 2022] GET /identity/v3/role_assignments?user.id=330389040c4347b6b47e22817fa80efc&scope.project.id=c68a6eefe1c74e299927c4592703857d&role.id=a1c22a1558c34c1d9d262bf1da31887e => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:32.088276 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21f55-e267-4380-bbd4-d8727a0ac514 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:32.088818 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21f55-e267-4380-bbd4-d8727a0ac514 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:32.089250 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21f55-e267-4380-bbd4-d8727a0ac514 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:32.091771 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 140/268] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:13:32.098544 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b5d2b-dcd0-476d-b8d6-9fdbcf7a334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:32.099115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b5d2b-dcd0-476d-b8d6-9fdbcf7a334a None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:32.099392 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b5d2b-dcd0-476d-b8d6-9fdbcf7a334a None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:32.099664 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b5d2b-dcd0-476d-b8d6-9fdbcf7a334a None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:32.102628 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edfb39-9343-4b43-b3b1-f0b9066f2fef None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:32.103118 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edfb39-9343-4b43-b3b1-f0b9066f2fef None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:32.103537 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edfb39-9343-4b43-b3b1-f0b9066f2fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:32.105920 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b5d2b-dcd0-476d-b8d6-9fdbcf7a334a None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:32.112583 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b5d2b-dcd0-476d-b8d6-9fdbcf7a334a None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:32.112583 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 129/269] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:31 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:32.133981 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b5d2b-dcd0-476d-b8d6-9fdbcf7a334a None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:32.140798 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-b5edfb39-9343-4b43-b3b1-f0b9066f2fef None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:32.142200 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-b5edfb39-9343-4b43-b3b1-f0b9066f2fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:32.232106 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:32.274543 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 141/270] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:32.330910 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b5d2b-dcd0-476d-b8d6-9fdbcf7a334a None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:32.396447 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f20c8-31c8-4541-87aa-02354e1c948e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:32.397347 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f20c8-31c8-4541-87aa-02354e1c948e None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:32.397625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f20c8-31c8-4541-87aa-02354e1c948e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:32.397893 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f20c8-31c8-4541-87aa-02354e1c948e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:32.398635 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f20c8-31c8-4541-87aa-02354e1c948e None admin] RBAC: Adding query filter params (role.id=753aa4902b7544299c8bed1f59c1153e, scope.project.id=c68a6eefe1c74e299927c4592703857d, user.id=330389040c4347b6b47e22817fa80efc) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:32.398943 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f20c8-31c8-4541-87aa-02354e1c948e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:32.400453 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f20c8-31c8-4541-87aa-02354e1c948e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:32.407750 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 130/271] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:32 2022] GET /identity/v3/role_assignments?user.id=330389040c4347b6b47e22817fa80efc&scope.project.id=c68a6eefe1c74e299927c4592703857d&role.id=753aa4902b7544299c8bed1f59c1153e => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:32.562689 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fff4c-3a6b-40c0-9599-027db5103a6c None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:32.562971 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fff4c-3a6b-40c0-9599-027db5103a6c None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:32.563498 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fff4c-3a6b-40c0-9599-027db5103a6c None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:32.565478 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 142/272] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:32.570872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97f85d-562d-41a9-8bf8-0c26f5828289 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:32.571146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97f85d-562d-41a9-8bf8-0c26f5828289 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:32.571590 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97f85d-562d-41a9-8bf8-0c26f5828289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:32.597767 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-ef97f85d-562d-41a9-8bf8-0c26f5828289 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:32.599250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-ef97f85d-562d-41a9-8bf8-0c26f5828289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:32.601948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:32.695815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 131/273] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:32.704884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749515d2-0a39-4a4e-a945-c95c88bf10f1 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:32.705172 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749515d2-0a39-4a4e-a945-c95c88bf10f1 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:32.705441 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749515d2-0a39-4a4e-a945-c95c88bf10f1 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:32.706822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 143/274] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:32.712093 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f50994-ef20-49a6-b4bc-13b073999e55 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:32.712384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f50994-ef20-49a6-b4bc-13b073999e55 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:32.712694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f50994-ef20-49a6-b4bc-13b073999e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:32.728782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749515d2-0a39-4a4e-a945-c95c88bf10f1 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:32.741063 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-12f50994-ef20-49a6-b4bc-13b073999e55 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:32.742692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-12f50994-ef20-49a6-b4bc-13b073999e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:32.839968 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 132/275] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:13:32.876274 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749515d2-0a39-4a4e-a945-c95c88bf10f1 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:32.914605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32f312-d791-4c2c-9ee0-f3505f3f0c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:32.915576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32f312-d791-4c2c-9ee0-f3505f3f0c25 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:32.916048 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32f312-d791-4c2c-9ee0-f3505f3f0c25 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:32.916507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32f312-d791-4c2c-9ee0-f3505f3f0c25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:32.928304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32f312-d791-4c2c-9ee0-f3505f3f0c25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-9b32f312-d791-4c2c-9ee0-f3505f3f0c25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:32.934535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:32.935502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:32.936381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:32.936381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:32.936381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:32.936381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:32.936381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:32.936381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:32.936381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:32.936381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:32.936381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:32.936381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:32.936381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:32.936381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:32.938443 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 144/276] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:32.944822 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f50994-ef20-49a6-b4bc-13b073999e55 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:33.018718 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:33.057448 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f50994-ef20-49a6-b4bc-13b073999e55 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:33.068410 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32f312-d791-4c2c-9ee0-f3505f3f0c25 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:33.096335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370645a-d9b5-40b9-8f7c-c3a65b819b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:33.097002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370645a-d9b5-40b9-8f7c-c3a65b819b73 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:33.097303 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370645a-d9b5-40b9-8f7c-c3a65b819b73 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:33.097887 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370645a-d9b5-40b9-8f7c-c3a65b819b73 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:33.098218 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370645a-d9b5-40b9-8f7c-c3a65b819b73 None admin] RBAC: Adding query filter params (name=member) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:33.098525 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370645a-d9b5-40b9-8f7c-c3a65b819b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:33.099918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370645a-d9b5-40b9-8f7c-c3a65b819b73 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:33.109114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 133/277] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:33.114837 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370645a-d9b5-40b9-8f7c-c3a65b819b73 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:33.126593 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:33.186644 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32f312-d791-4c2c-9ee0-f3505f3f0c25 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:33.226578 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370645a-d9b5-40b9-8f7c-c3a65b819b73 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:33.228692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca856220-32f4-403b-8352-222486a3dcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:33.229444 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca856220-32f4-403b-8352-222486a3dcf2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:33.229731 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca856220-32f4-403b-8352-222486a3dcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:33.230046 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca856220-32f4-403b-8352-222486a3dcf2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:33.242319 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca856220-32f4-403b-8352-222486a3dcf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-ca856220-32f4-403b-8352-222486a3dcf2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:33.247795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:33.248736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:33.249542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:33.249542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:33.249542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:33.249542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:33.249542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:33.249542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:33.249542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:33.249542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:33.249542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:33.249542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:33.249542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:33.249542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:33.249542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 145/278] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:13:33.250204 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca856220-32f4-403b-8352-222486a3dcf2 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:33.265472 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:33.272353 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a92761-3029-477a-919f-2cda9c590237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:33.279232 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a92761-3029-477a-919f-2cda9c590237 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:33.279232 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a92761-3029-477a-919f-2cda9c590237 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:33.279232 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a92761-3029-477a-919f-2cda9c590237 None admin] PATH_INFO: `/v3/users/cd83484ff568461784b026b5d5178e0b` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:33.290035 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a92761-3029-477a-919f-2cda9c590237 None admin] RBAC: Authorizing `identity:get_user(user_id=cd83484ff568461784b026b5d5178e0b)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:33.291550 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a92761-3029-477a-919f-2cda9c590237 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:33.299400 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 134/279] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:33 2022] GET /identity/v3/users/cd83484ff568461784b026b5d5178e0b => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:33.299400 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a92761-3029-477a-919f-2cda9c590237 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:33.382563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca856220-32f4-403b-8352-222486a3dcf2 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:33.393584 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:33.409741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a92761-3029-477a-919f-2cda9c590237 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:33.425720 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc21f89-1ab2-48ed-8c04-510e26342673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:33.426962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21f89-1ab2-48ed-8c04-510e26342673 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:33.427445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21f89-1ab2-48ed-8c04-510e26342673 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:33.427874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc21f89-1ab2-48ed-8c04-510e26342673 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:33.429151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc21f89-1ab2-48ed-8c04-510e26342673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:33.431009 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc21f89-1ab2-48ed-8c04-510e26342673 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:33.432755 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 146/280] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:13:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:33.434211 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc21f89-1ab2-48ed-8c04-510e26342673 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:33.450984 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456e9e8-75b1-47fa-b1c2-922262159829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:33.451652 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456e9e8-75b1-47fa-b1c2-922262159829 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:33.451877 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456e9e8-75b1-47fa-b1c2-922262159829 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:33.452151 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456e9e8-75b1-47fa-b1c2-922262159829 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:33.452858 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456e9e8-75b1-47fa-b1c2-922262159829 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:33.453159 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456e9e8-75b1-47fa-b1c2-922262159829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:33.454550 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456e9e8-75b1-47fa-b1c2-922262159829 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:33.463325 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 135/281] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:33.464154 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456e9e8-75b1-47fa-b1c2-922262159829 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:33.529105 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:33.574275 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc21f89-1ab2-48ed-8c04-510e26342673 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:33.588582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456e9e8-75b1-47fa-b1c2-922262159829 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:33.622745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e628e-23dd-4ed0-9e14-a60d803a0b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:33.623397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e628e-23dd-4ed0-9e14-a60d803a0b26 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:33.623686 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e628e-23dd-4ed0-9e14-a60d803a0b26 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:33.624055 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e628e-23dd-4ed0-9e14-a60d803a0b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:33.625011 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e628e-23dd-4ed0-9e14-a60d803a0b26 None admin] RBAC: Adding query filter params (role.id=b7001437cbb84adc825e214c44d6e551, user.id=cd83484ff568461784b026b5d5178e0b, scope.system=all) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:33.625327 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e628e-23dd-4ed0-9e14-a60d803a0b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:33.626985 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e628e-23dd-4ed0-9e14-a60d803a0b26 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:33.632374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 147/282] 10.222.0.43 () {56 vars in 1308 bytes} [Sat Sep 3 21:13:33 2022] GET /identity/v3/role_assignments?user.id=cd83484ff568461784b026b5d5178e0b&scope.system=all&role.id=b7001437cbb84adc825e214c44d6e551 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:33.633225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e628e-23dd-4ed0-9e14-a60d803a0b26 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:33.642794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b71118-75a4-4c31-9a7e-fd1e999a7bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:33.644598 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b71118-75a4-4c31-9a7e-fd1e999a7bf6 None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:33.645096 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b71118-75a4-4c31-9a7e-fd1e999a7bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:33.645568 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b71118-75a4-4c31-9a7e-fd1e999a7bf6 None admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:33.647269 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b71118-75a4-4c31-9a7e-fd1e999a7bf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:33.650048 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b71118-75a4-4c31-9a7e-fd1e999a7bf6 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:33.690912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:33.769613 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 136/283] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Sep 3 21:13:33 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:13:33.770912 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cd926-29dc-473f-81c6-0d90628f904c None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:33.771200 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cd926-29dc-473f-81c6-0d90628f904c None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:33.771475 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cd926-29dc-473f-81c6-0d90628f904c None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:33.774085 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 137/284] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:33.779886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e628e-23dd-4ed0-9e14-a60d803a0b26 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:33.780067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35235203-f320-4d4e-9b02-e6c467ac990e None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:33.780297 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35235203-f320-4d4e-9b02-e6c467ac990e None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:33.780615 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35235203-f320-4d4e-9b02-e6c467ac990e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:33.802104 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-35235203-f320-4d4e-9b02-e6c467ac990e None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:33.803396 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-35235203-f320-4d4e-9b02-e6c467ac990e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:33.845085 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0417cc9-ff39-489c-8449-2f11b8a20e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:33.846047 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0417cc9-ff39-489c-8449-2f11b8a20e8a None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:33.846543 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0417cc9-ff39-489c-8449-2f11b8a20e8a None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:33.847023 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0417cc9-ff39-489c-8449-2f11b8a20e8a None admin] PATH_INFO: `/v3/users/a196b889e2c340b99ca12c745cfa0c24` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:33.849274 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0417cc9-ff39-489c-8449-2f11b8a20e8a None admin] RBAC: Authorizing `identity:get_user(user_id=a196b889e2c340b99ca12c745cfa0c24)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:33.852060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0417cc9-ff39-489c-8449-2f11b8a20e8a None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:33.856594 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 148/285] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:33 2022] GET /identity/v3/users/a196b889e2c340b99ca12c745cfa0c24 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:33.862513 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0417cc9-ff39-489c-8449-2f11b8a20e8a None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:33.903474 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 138/286] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:13:33.994667 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0417cc9-ff39-489c-8449-2f11b8a20e8a None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:34.005755 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:34.036939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ac845-20df-4595-81cd-c5d346136ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:34.037530 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ac845-20df-4595-81cd-c5d346136ea8 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:34.037815 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ac845-20df-4595-81cd-c5d346136ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:34.038093 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ac845-20df-4595-81cd-c5d346136ea8 None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:34.039275 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ac845-20df-4595-81cd-c5d346136ea8 None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:34.040829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ac845-20df-4595-81cd-c5d346136ea8 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:34.043029 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 149/287] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:33 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:34.050029 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35235203-f320-4d4e-9b02-e6c467ac990e None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:34.103145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:34.190750 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35235203-f320-4d4e-9b02-e6c467ac990e None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:34.236220 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233426e-4f5e-445b-8cf3-bdb71781b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:34.236962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233426e-4f5e-445b-8cf3-bdb71781b3a4 None admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:34.237239 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233426e-4f5e-445b-8cf3-bdb71781b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:34.237521 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233426e-4f5e-445b-8cf3-bdb71781b3a4 None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d/users/a196b889e2c340b99ca12c745cfa0c24/roles/46aa5e1d5e704ae78369f7707f6977dc` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:34.240173 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233426e-4f5e-445b-8cf3-bdb71781b3a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c68a6eefe1c74e299927c4592703857d, user_id=a196b889e2c340b99ca12c745cfa0c24, role_id=46aa5e1d5e704ae78369f7707f6977dc)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:34.241674 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233426e-4f5e-445b-8cf3-bdb71781b3a4 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:34.281323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ac845-20df-4595-81cd-c5d346136ea8 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:34.312117 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 139/288] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:13:34 2022] PUT /identity/v3/projects/c68a6eefe1c74e299927c4592703857d/users/a196b889e2c340b99ca12c745cfa0c24/roles/46aa5e1d5e704ae78369f7707f6977dc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:13:34.428309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ac845-20df-4595-81cd-c5d346136ea8 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:34.481317 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10bd2b-4058-40af-9c84-cdea54cd4006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:34.481987 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10bd2b-4058-40af-9c84-cdea54cd4006 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:34.482270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10bd2b-4058-40af-9c84-cdea54cd4006 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:34.482546 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10bd2b-4058-40af-9c84-cdea54cd4006 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:34.498496 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10bd2b-4058-40af-9c84-cdea54cd4006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-9c10bd2b-4058-40af-9c84-cdea54cd4006 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:34.503718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:34.504745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:34.505542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:34.505542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:34.505542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:34.505542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:34.505542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:34.505542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:34.505542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:34.505542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:34.505542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:34.505542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:34.505542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:34.505542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:34.505542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 150/289] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:13:34.512908 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233426e-4f5e-445b-8cf3-bdb71781b3a4 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:34.634922 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:34.643034 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233426e-4f5e-445b-8cf3-bdb71781b3a4 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:34.686900 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce90fa4-a08a-4c73-89e3-4722e9d29a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:34.687546 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce90fa4-a08a-4c73-89e3-4722e9d29a96 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:34.687874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce90fa4-a08a-4c73-89e3-4722e9d29a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:34.688153 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce90fa4-a08a-4c73-89e3-4722e9d29a96 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:34.688880 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce90fa4-a08a-4c73-89e3-4722e9d29a96 None admin] RBAC: Adding query filter params (name=member) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:34.689183 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce90fa4-a08a-4c73-89e3-4722e9d29a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:34.690813 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce90fa4-a08a-4c73-89e3-4722e9d29a96 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:34.707246 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 140/290] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:34.708447 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10bd2b-4058-40af-9c84-cdea54cd4006 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:34.758563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:34.847441 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10bd2b-4058-40af-9c84-cdea54cd4006 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:34.898409 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff1366-de40-458c-b849-a628cfe25286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:34.898987 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff1366-de40-458c-b849-a628cfe25286 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:34.899269 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff1366-de40-458c-b849-a628cfe25286 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:34.899541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff1366-de40-458c-b849-a628cfe25286 None admin] PATH_INFO: `/v3/users/ad7c6e872a854f4d9453f710757976d5` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:34.900736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff1366-de40-458c-b849-a628cfe25286 None admin] RBAC: Authorizing `identity:get_user(user_id=ad7c6e872a854f4d9453f710757976d5)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:34.902826 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff1366-de40-458c-b849-a628cfe25286 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:34.904483 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 151/291] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:34 2022] GET /identity/v3/users/ad7c6e872a854f4d9453f710757976d5 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:34.910348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce90fa4-a08a-4c73-89e3-4722e9d29a96 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:35.024576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce90fa4-a08a-4c73-89e3-4722e9d29a96 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:35.062990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72cc45-5138-4a2e-a556-85dcc187a22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:35.063609 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72cc45-5138-4a2e-a556-85dcc187a22c None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:35.063961 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72cc45-5138-4a2e-a556-85dcc187a22c None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:35.064238 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72cc45-5138-4a2e-a556-85dcc187a22c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:35.096913 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:35.140286 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72cc45-5138-4a2e-a556-85dcc187a22c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:35.141838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72cc45-5138-4a2e-a556-85dcc187a22c None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:35.254723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 141/292] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:35.256081 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff1366-de40-458c-b849-a628cfe25286 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:35.424640 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff1366-de40-458c-b849-a628cfe25286 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:35.426442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:35.468905 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e66185-eaf1-4a2b-817e-af187535022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:35.469568 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e66185-eaf1-4a2b-817e-af187535022d None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:35.469857 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e66185-eaf1-4a2b-817e-af187535022d None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:35.470141 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e66185-eaf1-4a2b-817e-af187535022d None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:35.475467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e66185-eaf1-4a2b-817e-af187535022d None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:35.477356 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e66185-eaf1-4a2b-817e-af187535022d None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:35.480474 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 152/293] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:35 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:35.486655 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72cc45-5138-4a2e-a556-85dcc187a22c None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:35.594996 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:35.658861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72cc45-5138-4a2e-a556-85dcc187a22c None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:35.716699 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80243e-0eb6-4797-9b2c-7fa7bd30d53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:35.717628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80243e-0eb6-4797-9b2c-7fa7bd30d53b None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:35.718089 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80243e-0eb6-4797-9b2c-7fa7bd30d53b None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:35.719153 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80243e-0eb6-4797-9b2c-7fa7bd30d53b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:35.720093 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80243e-0eb6-4797-9b2c-7fa7bd30d53b None admin] RBAC: Adding query filter params (role.id=b7001437cbb84adc825e214c44d6e551, scope.project.id=c68a6eefe1c74e299927c4592703857d, user.id=ad7c6e872a854f4d9453f710757976d5) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:35.720612 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80243e-0eb6-4797-9b2c-7fa7bd30d53b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:35.722391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80243e-0eb6-4797-9b2c-7fa7bd30d53b None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:35.733529 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 142/294] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:35 2022] GET /identity/v3/role_assignments?user.id=ad7c6e872a854f4d9453f710757976d5&scope.project.id=c68a6eefe1c74e299927c4592703857d&role.id=b7001437cbb84adc825e214c44d6e551 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:36.366077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182be4bd-2994-42eb-bcd5-d88fb3e16f12 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:36.366742 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182be4bd-2994-42eb-bcd5-d88fb3e16f12 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:36.367230 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182be4bd-2994-42eb-bcd5-d88fb3e16f12 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:36.369060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 153/295] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:36.375823 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c55fe-de98-48b6-bd2b-c0eb92c58cd5 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:36.376752 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c55fe-de98-48b6-bd2b-c0eb92c58cd5 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:36.377235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c55fe-de98-48b6-bd2b-c0eb92c58cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:36.401109 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-810c55fe-de98-48b6-bd2b-c0eb92c58cd5 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:36.403173 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-810c55fe-de98-48b6-bd2b-c0eb92c58cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:36.500453 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 143/296] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:36.752592 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c158b-5f68-4190-8f61-9f0831305c77 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:36.752592 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c158b-5f68-4190-8f61-9f0831305c77 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:36.752592 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c158b-5f68-4190-8f61-9f0831305c77 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:36.753565 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 154/297] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:36.759298 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedef35d-dba0-44dc-8587-a3c99c425788 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:36.759860 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedef35d-dba0-44dc-8587-a3c99c425788 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:36.760334 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedef35d-dba0-44dc-8587-a3c99c425788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:36.780596 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-aedef35d-dba0-44dc-8587-a3c99c425788 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:36.782229 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-aedef35d-dba0-44dc-8587-a3c99c425788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:36.835888 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:36.857991 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 144/298] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:36.861632 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c158b-5f68-4190-8f61-9f0831305c77 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:36.884383 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69097685-d844-41a1-82a6-f19dee72feaa None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:36.884938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69097685-d844-41a1-82a6-f19dee72feaa None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:36.885350 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69097685-d844-41a1-82a6-f19dee72feaa None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:36.887685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 145/299] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:36.894199 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5d9d8-269b-46ca-b8ca-98aa8f76e64b None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:36.894486 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5d9d8-269b-46ca-b8ca-98aa8f76e64b None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:36.894741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5d9d8-269b-46ca-b8ca-98aa8f76e64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:36.916637 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-22c5d9d8-269b-46ca-b8ca-98aa8f76e64b None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:36.918600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-22c5d9d8-269b-46ca-b8ca-98aa8f76e64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:36.990444 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c158b-5f68-4190-8f61-9f0831305c77 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:37.027014 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 146/300] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:37.042075 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586adc0f-4128-413e-b023-03cc03f0d4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:37.043614 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586adc0f-4128-413e-b023-03cc03f0d4c0 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:37.044075 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586adc0f-4128-413e-b023-03cc03f0d4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:37.044488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586adc0f-4128-413e-b023-03cc03f0d4c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:37.058563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586adc0f-4128-413e-b023-03cc03f0d4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-586adc0f-4128-413e-b023-03cc03f0d4c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:37.064077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:37.065242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:37.066122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:37.066122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:37.066122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:37.066122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:37.066122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:37.066122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:37.066122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:37.066122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:37.066122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:37.066122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:37.066122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:37.066122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:37.068450 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 155/301] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:37.080915 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5d9d8-269b-46ca-b8ca-98aa8f76e64b None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:37.170916 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29631e-2ae8-43f1-a960-27d643c9b9a5 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:37.171298 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29631e-2ae8-43f1-a960-27d643c9b9a5 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:37.171594 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29631e-2ae8-43f1-a960-27d643c9b9a5 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:37.173211 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 156/302] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:13:37.178363 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce3340-2d57-49d5-8af9-13b2095620ea None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:37.178645 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce3340-2d57-49d5-8af9-13b2095620ea None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:37.178921 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce3340-2d57-49d5-8af9-13b2095620ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:37.200389 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-95ce3340-2d57-49d5-8af9-13b2095620ea None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:37.201671 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5d9d8-269b-46ca-b8ca-98aa8f76e64b None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:37.201795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-95ce3340-2d57-49d5-8af9-13b2095620ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:37.218062 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:37.233581 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:37.242945 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0efb1-8e91-4e2f-bfe3-d71389731a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:37.243554 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0efb1-8e91-4e2f-bfe3-d71389731a29 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:37.243838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0efb1-8e91-4e2f-bfe3-d71389731a29 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:37.244106 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0efb1-8e91-4e2f-bfe3-d71389731a29 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:37.244806 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0efb1-8e91-4e2f-bfe3-d71389731a29 None admin] RBAC: Adding query filter params (name=member) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:37.245124 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0efb1-8e91-4e2f-bfe3-d71389731a29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:37.247231 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0efb1-8e91-4e2f-bfe3-d71389731a29 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:37.257512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 147/303] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:37.258404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0efb1-8e91-4e2f-bfe3-d71389731a29 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:37.287362 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 157/304] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:13:37.297563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce3340-2d57-49d5-8af9-13b2095620ea None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:37.383431 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0efb1-8e91-4e2f-bfe3-d71389731a29 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:37.421177 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce3340-2d57-49d5-8af9-13b2095620ea None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:37.423915 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84af47c-f472-47d7-af1f-42c320fbafb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:37.424665 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84af47c-f472-47d7-af1f-42c320fbafb0 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:37.424951 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84af47c-f472-47d7-af1f-42c320fbafb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:37.425228 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84af47c-f472-47d7-af1f-42c320fbafb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:37.426341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84af47c-f472-47d7-af1f-42c320fbafb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:37.427829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84af47c-f472-47d7-af1f-42c320fbafb0 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:37.429603 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 148/305] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:13:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:37.435629 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84af47c-f472-47d7-af1f-42c320fbafb0 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:37.460141 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0105915-2866-4dd5-bcd8-dce8b4de466e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:37.461153 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0105915-2866-4dd5-bcd8-dce8b4de466e None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:37.461638 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0105915-2866-4dd5-bcd8-dce8b4de466e None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:37.462088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0105915-2866-4dd5-bcd8-dce8b4de466e None admin] PATH_INFO: `/v3/users/cd83484ff568461784b026b5d5178e0b` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:37.463665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0105915-2866-4dd5-bcd8-dce8b4de466e None admin] RBAC: Authorizing `identity:get_user(user_id=cd83484ff568461784b026b5d5178e0b)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:37.465853 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0105915-2866-4dd5-bcd8-dce8b4de466e None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:37.468030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 158/306] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:37 2022] GET /identity/v3/users/cd83484ff568461784b026b5d5178e0b => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:37.469015 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0105915-2866-4dd5-bcd8-dce8b4de466e None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:37.491634 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:37.507776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:37.567388 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84af47c-f472-47d7-af1f-42c320fbafb0 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:37.600175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0105915-2866-4dd5-bcd8-dce8b4de466e None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:37.613504 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8cb34-83df-42f4-b711-9283fbb3f126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:37.614142 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8cb34-83df-42f4-b711-9283fbb3f126 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:37.614986 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8cb34-83df-42f4-b711-9283fbb3f126 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:37.615282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8cb34-83df-42f4-b711-9283fbb3f126 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:37.626455 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8cb34-83df-42f4-b711-9283fbb3f126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-27f8cb34-83df-42f4-b711-9283fbb3f126 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:37.631829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:37.632944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:37.633938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:37.633938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:37.633938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:37.633938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:37.633938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:37.633938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:37.633938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:37.633938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:37.633938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:37.633938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:37.633938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:37.633938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:37.633938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 149/307] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:37.634784 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8cb34-83df-42f4-b711-9283fbb3f126 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:37.640851 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba4ee5-6af8-413d-9ac3-be2ea193dae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:37.641469 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba4ee5-6af8-413d-9ac3-be2ea193dae8 None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:37.641750 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba4ee5-6af8-413d-9ac3-be2ea193dae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:37.642016 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba4ee5-6af8-413d-9ac3-be2ea193dae8 None admin] PATH_INFO: `/v3/groups` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:37.642638 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba4ee5-6af8-413d-9ac3-be2ea193dae8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:37.648281 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba4ee5-6af8-413d-9ac3-be2ea193dae8 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:37.737047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8cb34-83df-42f4-b711-9283fbb3f126 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:37.738608 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:37.744143 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 159/308] 10.222.0.43 () {60 vars in 1134 bytes} [Sat Sep 3 21:13:37 2022] POST /identity/v3/groups => generated 229 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:13:37.745012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba4ee5-6af8-413d-9ac3-be2ea193dae8 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:37.780862 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5298d40-cc95-4cc8-807f-23c52514df07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:37.781546 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298d40-cc95-4cc8-807f-23c52514df07 None admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:37.781830 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298d40-cc95-4cc8-807f-23c52514df07 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:37.782106 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5298d40-cc95-4cc8-807f-23c52514df07 None admin] PATH_INFO: `/v3/system/users/cd83484ff568461784b026b5d5178e0b/roles/b7001437cbb84adc825e214c44d6e551` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:37.783693 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5298d40-cc95-4cc8-807f-23c52514df07 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cd83484ff568461784b026b5d5178e0b, role_id=b7001437cbb84adc825e214c44d6e551)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:37.785193 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5298d40-cc95-4cc8-807f-23c52514df07 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:37.851584 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:37.865715 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba4ee5-6af8-413d-9ac3-be2ea193dae8 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:37.903495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 150/309] 10.222.0.43 () {58 vars in 1334 bytes} [Sat Sep 3 21:13:37 2022] PUT /identity/v3/system/users/cd83484ff568461784b026b5d5178e0b/roles/b7001437cbb84adc825e214c44d6e551 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:13:37.903495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5298d40-cc95-4cc8-807f-23c52514df07 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:37.918891 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770362b5-48dd-4e4b-97b1-e48303b12df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:37.919667 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770362b5-48dd-4e4b-97b1-e48303b12df4 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:37.920111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770362b5-48dd-4e4b-97b1-e48303b12df4 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:37.920373 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770362b5-48dd-4e4b-97b1-e48303b12df4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:37.937266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770362b5-48dd-4e4b-97b1-e48303b12df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-770362b5-48dd-4e4b-97b1-e48303b12df4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:37.944140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:37.945232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:37.946162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:37.946162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:37.946162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:37.946162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:37.946162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:37.946162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:37.946162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:37.946162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:37.946162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:37.946162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:37.946162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:37.946162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:37.950041 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 160/310] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:37.951024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770362b5-48dd-4e4b-97b1-e48303b12df4 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:38.065592 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5298d40-cc95-4cc8-807f-23c52514df07 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:38.081241 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770362b5-48dd-4e4b-97b1-e48303b12df4 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:38.118447 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892751a8-a0c4-438a-80c7-85424f0fe62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:38.119208 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892751a8-a0c4-438a-80c7-85424f0fe62d None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:38.120071 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892751a8-a0c4-438a-80c7-85424f0fe62d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:38.120071 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892751a8-a0c4-438a-80c7-85424f0fe62d None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:38.121481 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892751a8-a0c4-438a-80c7-85424f0fe62d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:38.121666 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb382be6-06fd-4371-b613-cd47212a4a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:38.121765 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892751a8-a0c4-438a-80c7-85424f0fe62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:38.122114 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382be6-06fd-4371-b613-cd47212a4a50 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:38.122396 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382be6-06fd-4371-b613-cd47212a4a50 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:38.122672 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382be6-06fd-4371-b613-cd47212a4a50 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:38.123159 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892751a8-a0c4-438a-80c7-85424f0fe62d None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:38.123330 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb382be6-06fd-4371-b613-cd47212a4a50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:38.123639 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb382be6-06fd-4371-b613-cd47212a4a50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:38.126429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb382be6-06fd-4371-b613-cd47212a4a50 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:38.133667 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 151/311] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:38.134528 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 161/312] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:38.140424 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892751a8-a0c4-438a-80c7-85424f0fe62d None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:38.145112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb382be6-06fd-4371-b613-cd47212a4a50 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:38.161880 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:38.173297 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:38.263588 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb382be6-06fd-4371-b613-cd47212a4a50 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:38.267105 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892751a8-a0c4-438a-80c7-85424f0fe62d None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:38.299758 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef442ea-11d2-4447-bb6e-aa6932f9a8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:38.300504 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef442ea-11d2-4447-bb6e-aa6932f9a8f2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:38.300884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef442ea-11d2-4447-bb6e-aa6932f9a8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:38.301235 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef442ea-11d2-4447-bb6e-aa6932f9a8f2 None admin] PATH_INFO: `/v3/users/a196b889e2c340b99ca12c745cfa0c24` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:38.302455 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef442ea-11d2-4447-bb6e-aa6932f9a8f2 None admin] RBAC: Authorizing `identity:get_user(user_id=a196b889e2c340b99ca12c745cfa0c24)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:38.304039 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef442ea-11d2-4447-bb6e-aa6932f9a8f2 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:38.305997 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 162/313] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:38 2022] GET /identity/v3/users/a196b889e2c340b99ca12c745cfa0c24 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:38.312174 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef442ea-11d2-4447-bb6e-aa6932f9a8f2 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:38.315216 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9e7fc-b411-4ea6-bd45-cc5e6c6da96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:38.316322 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9e7fc-b411-4ea6-bd45-cc5e6c6da96b None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:38.317629 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9e7fc-b411-4ea6-bd45-cc5e6c6da96b None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:38.317984 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9e7fc-b411-4ea6-bd45-cc5e6c6da96b None admin] PATH_INFO: `/v3/users/15a941c50d594e58b032955772b8a042` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:38.335952 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9e7fc-b411-4ea6-bd45-cc5e6c6da96b None admin] RBAC: Authorizing `identity:get_user(user_id=15a941c50d594e58b032955772b8a042)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:38.338240 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9e7fc-b411-4ea6-bd45-cc5e6c6da96b None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:38.340680 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 152/314] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:38 2022] GET /identity/v3/users/15a941c50d594e58b032955772b8a042 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:38.346280 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9e7fc-b411-4ea6-bd45-cc5e6c6da96b None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:38.441759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:38.453150 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef442ea-11d2-4447-bb6e-aa6932f9a8f2 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:38.474747 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:38.485936 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9e7fc-b411-4ea6-bd45-cc5e6c6da96b None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:38.497726 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa222ba3-ad8a-49d2-aef4-cc83c41828df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:38.498601 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa222ba3-ad8a-49d2-aef4-cc83c41828df None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:38.498975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa222ba3-ad8a-49d2-aef4-cc83c41828df None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:38.499312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa222ba3-ad8a-49d2-aef4-cc83c41828df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:38.534148 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d07a2-d76a-49a1-b773-d132ca3fc4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:38.535380 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d07a2-d76a-49a1-b773-d132ca3fc4a2 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:38.536242 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d07a2-d76a-49a1-b773-d132ca3fc4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:38.536702 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d07a2-d76a-49a1-b773-d132ca3fc4a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:38.537911 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d07a2-d76a-49a1-b773-d132ca3fc4a2 None admin] RBAC: Adding query filter params (role.id=46aa5e1d5e704ae78369f7707f6977dc, user.id=15a941c50d594e58b032955772b8a042, scope.system=all) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:38.538391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d07a2-d76a-49a1-b773-d132ca3fc4a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:38.541381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d07a2-d76a-49a1-b773-d132ca3fc4a2 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:38.554491 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 153/315] 10.222.0.43 () {56 vars in 1308 bytes} [Sat Sep 3 21:13:38 2022] GET /identity/v3/role_assignments?user.id=15a941c50d594e58b032955772b8a042&scope.system=all&role.id=46aa5e1d5e704ae78369f7707f6977dc => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:38.591947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa222ba3-ad8a-49d2-aef4-cc83c41828df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:38.594079 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa222ba3-ad8a-49d2-aef4-cc83c41828df None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:38.695821 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:38.725031 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 163/316] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 21:13:38.731443 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d07a2-d76a-49a1-b773-d132ca3fc4a2 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:38.862279 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d07a2-d76a-49a1-b773-d132ca3fc4a2 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:38.903969 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9284696-ccf8-4bfb-8a18-568e2a5c2b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:38.904642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9284696-ccf8-4bfb-8a18-568e2a5c2b6f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:38.904931 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9284696-ccf8-4bfb-8a18-568e2a5c2b6f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:38.905202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9284696-ccf8-4bfb-8a18-568e2a5c2b6f None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:38.906383 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9284696-ccf8-4bfb-8a18-568e2a5c2b6f None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:38.907836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9284696-ccf8-4bfb-8a18-568e2a5c2b6f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:38.909884 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 154/317] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:38 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:38.915610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa222ba3-ad8a-49d2-aef4-cc83c41828df None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:39.030383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa222ba3-ad8a-49d2-aef4-cc83c41828df None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:39.067955 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73962094-3f12-4901-a8d9-088a6ac98cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:39.068625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73962094-3f12-4901-a8d9-088a6ac98cd0 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:39.068909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73962094-3f12-4901-a8d9-088a6ac98cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:39.069185 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73962094-3f12-4901-a8d9-088a6ac98cd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:39.069909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73962094-3f12-4901-a8d9-088a6ac98cd0 None admin] RBAC: Adding query filter params (role.id=46aa5e1d5e704ae78369f7707f6977dc, scope.project.id=c68a6eefe1c74e299927c4592703857d, user.id=a196b889e2c340b99ca12c745cfa0c24) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:39.070215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73962094-3f12-4901-a8d9-088a6ac98cd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:39.071655 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73962094-3f12-4901-a8d9-088a6ac98cd0 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:39.079373 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 164/318] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:13:38 2022] GET /identity/v3/role_assignments?user.id=a196b889e2c340b99ca12c745cfa0c24&scope.project.id=c68a6eefe1c74e299927c4592703857d&role.id=46aa5e1d5e704ae78369f7707f6977dc => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:40.141358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c8e4f-f234-47d2-8131-b61ff2f05a46 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:40.141923 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c8e4f-f234-47d2-8131-b61ff2f05a46 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:40.141923 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c8e4f-f234-47d2-8131-b61ff2f05a46 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:40.143734 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 155/319] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:40.149686 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9084b-9613-4673-a11b-3b3339a05c73 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:40.150185 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9084b-9613-4673-a11b-3b3339a05c73 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:40.150267 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9084b-9613-4673-a11b-3b3339a05c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:40.170921 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-58e9084b-9613-4673-a11b-3b3339a05c73 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:40.172170 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-58e9084b-9613-4673-a11b-3b3339a05c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:40.216099 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:40.248950 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 165/320] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:40.295694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603d4a-7509-4e8e-b46a-3204d182a962 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:40.295886 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603d4a-7509-4e8e-b46a-3204d182a962 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:40.296148 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a603d4a-7509-4e8e-b46a-3204d182a962 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:40.297679 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 156/321] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:40.302970 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f63f4e-262c-431b-b443-4a33e468c9fd None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:40.303250 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f63f4e-262c-431b-b443-4a33e468c9fd None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:40.303530 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f63f4e-262c-431b-b443-4a33e468c9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:40.329513 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-00f63f4e-262c-431b-b443-4a33e468c9fd None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:40.330695 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-00f63f4e-262c-431b-b443-4a33e468c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:40.403792 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 166/322] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:40.586503 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a603d4a-7509-4e8e-b46a-3204d182a962 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:40.607670 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:40.699054 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a603d4a-7509-4e8e-b46a-3204d182a962 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:40.735222 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f63f4e-262c-431b-b443-4a33e468c9fd None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:40.742505 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74963676-407a-4243-be88-29b170759342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:40.743149 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74963676-407a-4243-be88-29b170759342 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:40.743423 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74963676-407a-4243-be88-29b170759342 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:40.743693 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74963676-407a-4243-be88-29b170759342 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:40.744843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74963676-407a-4243-be88-29b170759342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:40.746867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74963676-407a-4243-be88-29b170759342 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:40.748629 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 157/323] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:13:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:40.753938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74963676-407a-4243-be88-29b170759342 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:40.852070 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:40.853420 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f63f4e-262c-431b-b443-4a33e468c9fd None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:40.855652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:40.870198 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74963676-407a-4243-be88-29b170759342 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:40.894379 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b12439-df2c-4408-92b3-96e07b40ba17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:40.895012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b12439-df2c-4408-92b3-96e07b40ba17 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:40.895297 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b12439-df2c-4408-92b3-96e07b40ba17 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:40.895609 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b12439-df2c-4408-92b3-96e07b40ba17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:40.906860 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b12439-df2c-4408-92b3-96e07b40ba17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:40.907786 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8e3ff-e8c1-466f-9807-32ceb5ce1da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:40.908414 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8e3ff-e8c1-466f-9807-32ceb5ce1da7 None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:40.908741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8e3ff-e8c1-466f-9807-32ceb5ce1da7 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:40.909017 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8e3ff-e8c1-466f-9807-32ceb5ce1da7 None admin] PATH_INFO: `/v3/groups` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:40.909648 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8e3ff-e8c1-466f-9807-32ceb5ce1da7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:40.911108 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff8e3ff-e8c1-466f-9807-32ceb5ce1da7 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-57b12439-df2c-4408-92b3-96e07b40ba17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:40.912155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:40.913111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:40.913961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:40.913961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:40.913961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:40.913961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:40.913961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:40.913961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:40.913961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:40.913961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:40.913961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:40.913961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:40.913961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:40.913961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:40.913961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 167/324] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:13:40.915130 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23953c3a-f5c1-45b9-a222-2e51c710f896 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:40.915130 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23953c3a-f5c1-45b9-a222-2e51c710f896 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:40.915388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23953c3a-f5c1-45b9-a222-2e51c710f896 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:40.918344 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 168/325] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:40.920338 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23953c3a-f5c1-45b9-a222-2e51c710f896 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:41.024689 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23953c3a-f5c1-45b9-a222-2e51c710f896 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:41.030700 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 158/326] 10.222.0.43 () {60 vars in 1134 bytes} [Sat Sep 3 21:13:40 2022] POST /identity/v3/groups => generated 226 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 21:13:41.032013 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d7242-c715-462d-8bd4-f82e82af6bf4 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:41.032295 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d7242-c715-462d-8bd4-f82e82af6bf4 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:41.032590 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d7242-c715-462d-8bd4-f82e82af6bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:41.053585 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-d13d7242-c715-462d-8bd4-f82e82af6bf4 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:41.054852 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-d13d7242-c715-462d-8bd4-f82e82af6bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:41.069950 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d05f6e-2f2b-4bd2-8b58-ef156ebfd123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:41.070592 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d05f6e-2f2b-4bd2-8b58-ef156ebfd123 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:41.070879 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d05f6e-2f2b-4bd2-8b58-ef156ebfd123 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:41.071289 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d05f6e-2f2b-4bd2-8b58-ef156ebfd123 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:41.072056 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d05f6e-2f2b-4bd2-8b58-ef156ebfd123 None admin] RBAC: Adding query filter params (name=member) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:41.072371 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d05f6e-2f2b-4bd2-8b58-ef156ebfd123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:41.074118 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d05f6e-2f2b-4bd2-8b58-ef156ebfd123 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:41.084173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 169/327] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:41.092669 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d05f6e-2f2b-4bd2-8b58-ef156ebfd123 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:41.122761 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:41.153246 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 159/328] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:41.220289 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d05f6e-2f2b-4bd2-8b58-ef156ebfd123 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:41.262739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ce80c-b1de-41e9-941d-5c9cc8d57c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:41.263379 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ce80c-b1de-41e9-941d-5c9cc8d57c31 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:41.263661 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ce80c-b1de-41e9-941d-5c9cc8d57c31 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:41.263935 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ce80c-b1de-41e9-941d-5c9cc8d57c31 None admin] PATH_INFO: `/v3/users/cd83484ff568461784b026b5d5178e0b` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:41.265150 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ce80c-b1de-41e9-941d-5c9cc8d57c31 None admin] RBAC: Authorizing `identity:get_user(user_id=cd83484ff568461784b026b5d5178e0b)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:41.266611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ce80c-b1de-41e9-941d-5c9cc8d57c31 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:41.268193 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 170/329] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:41 2022] GET /identity/v3/users/cd83484ff568461784b026b5d5178e0b => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:41.274438 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d7242-c715-462d-8bd4-f82e82af6bf4 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:41.366099 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:41.392297 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d7242-c715-462d-8bd4-f82e82af6bf4 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:41.429789 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dba31a-a3ce-4404-8826-295c99b9b4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:41.430405 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dba31a-a3ce-4404-8826-295c99b9b4f0 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:41.430687 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dba31a-a3ce-4404-8826-295c99b9b4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:41.430953 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dba31a-a3ce-4404-8826-295c99b9b4f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:41.431674 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dba31a-a3ce-4404-8826-295c99b9b4f0 None admin] RBAC: Adding query filter params (role.id=b7001437cbb84adc825e214c44d6e551, user.id=cd83484ff568461784b026b5d5178e0b, scope.system=all) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:41.431979 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dba31a-a3ce-4404-8826-295c99b9b4f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:41.433821 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dba31a-a3ce-4404-8826-295c99b9b4f0 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:41.447305 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 160/330] 10.222.0.43 () {56 vars in 1308 bytes} [Sat Sep 3 21:13:41 2022] GET /identity/v3/role_assignments?user.id=cd83484ff568461784b026b5d5178e0b&scope.system=all&role.id=b7001437cbb84adc825e214c44d6e551 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:41.490161 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ce80c-b1de-41e9-941d-5c9cc8d57c31 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:41.610409 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:41.621650 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ce80c-b1de-41e9-941d-5c9cc8d57c31 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:41.667539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef805f-49a7-4f0c-aa26-f3929655cdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:41.668113 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef805f-49a7-4f0c-aa26-f3929655cdf3 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:41.668435 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef805f-49a7-4f0c-aa26-f3929655cdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:41.668824 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef805f-49a7-4f0c-aa26-f3929655cdf3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:41.680503 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef805f-49a7-4f0c-aa26-f3929655cdf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-3aef805f-49a7-4f0c-aa26-f3929655cdf3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:41.688383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:41.689418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:41.690223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:41.690223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:41.690223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:41.690223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:41.690223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:41.690223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:41.690223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:41.690223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:41.690223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:41.690223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:41.690223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:41.690223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:41.690223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 171/331] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:41.696379 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dba31a-a3ce-4404-8826-295c99b9b4f0 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:41.824356 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dba31a-a3ce-4404-8826-295c99b9b4f0 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:41.871113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aecf9-14ff-4f09-a82f-26d0daaea30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:41.871745 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aecf9-14ff-4f09-a82f-26d0daaea30a None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:41.872028 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aecf9-14ff-4f09-a82f-26d0daaea30a None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:41.872300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aecf9-14ff-4f09-a82f-26d0daaea30a None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:41.873024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aecf9-14ff-4f09-a82f-26d0daaea30a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:41.873335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aecf9-14ff-4f09-a82f-26d0daaea30a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:41.874780 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aecf9-14ff-4f09-a82f-26d0daaea30a None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:41.876850 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:41.888694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 161/332] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:41.895969 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef805f-49a7-4f0c-aa26-f3929655cdf3 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:42.042681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef805f-49a7-4f0c-aa26-f3929655cdf3 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:42.087792 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c548729-4700-4c08-bf09-c1fa6197cea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:42.088383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c548729-4700-4c08-bf09-c1fa6197cea2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:42.088708 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c548729-4700-4c08-bf09-c1fa6197cea2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:42.089612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c548729-4700-4c08-bf09-c1fa6197cea2 None admin] PATH_INFO: `/v3/users/15a941c50d594e58b032955772b8a042` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:42.091036 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c548729-4700-4c08-bf09-c1fa6197cea2 None admin] RBAC: Authorizing `identity:get_user(user_id=15a941c50d594e58b032955772b8a042)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:42.092600 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c548729-4700-4c08-bf09-c1fa6197cea2 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:42.094593 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 172/333] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:41 2022] GET /identity/v3/users/15a941c50d594e58b032955772b8a042 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:42.100140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aecf9-14ff-4f09-a82f-26d0daaea30a None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:42.242958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aecf9-14ff-4f09-a82f-26d0daaea30a None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:42.295037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2e425-4de3-44d9-a0c6-932dad8b0d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:42.296031 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2e425-4de3-44d9-a0c6-932dad8b0d58 None admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:42.296517 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2e425-4de3-44d9-a0c6-932dad8b0d58 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:42.297056 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2e425-4de3-44d9-a0c6-932dad8b0d58 None admin] PATH_INFO: `/v3/system/users/15a941c50d594e58b032955772b8a042/roles/46aa5e1d5e704ae78369f7707f6977dc` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:42.298790 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2e425-4de3-44d9-a0c6-932dad8b0d58 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=15a941c50d594e58b032955772b8a042, role_id=46aa5e1d5e704ae78369f7707f6977dc)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:42.300395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2e425-4de3-44d9-a0c6-932dad8b0d58 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:42.385759 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 162/334] 10.222.0.43 () {58 vars in 1334 bytes} [Sat Sep 3 21:13:42 2022] PUT /identity/v3/system/users/15a941c50d594e58b032955772b8a042/roles/46aa5e1d5e704ae78369f7707f6977dc => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:13:44.166173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527523f-6f66-435e-8715-9541f4e98491 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:44.166732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527523f-6f66-435e-8715-9541f4e98491 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:44.166732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527523f-6f66-435e-8715-9541f4e98491 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:44.169150 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 173/335] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:44.174652 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4163d-03ef-478e-818a-e8900e39ae9d None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:44.175521 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4163d-03ef-478e-818a-e8900e39ae9d None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:44.176007 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4163d-03ef-478e-818a-e8900e39ae9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:44.205699 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-f3b4163d-03ef-478e-818a-e8900e39ae9d None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:44.207280 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-f3b4163d-03ef-478e-818a-e8900e39ae9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:44.207839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24310ce-4bc0-45c7-b6a0-bb3dde5b2f6c None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:44.208131 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24310ce-4bc0-45c7-b6a0-bb3dde5b2f6c None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:44.208409 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24310ce-4bc0-45c7-b6a0-bb3dde5b2f6c None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:44.210088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 174/336] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:44.215344 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6b2c8-6281-4275-86d3-5254157b6d79 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:44.215631 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6b2c8-6281-4275-86d3-5254157b6d79 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:44.215912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6b2c8-6281-4275-86d3-5254157b6d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:44.284761 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-1ad6b2c8-6281-4275-86d3-5254157b6d79 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:44.284761 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-1ad6b2c8-6281-4275-86d3-5254157b6d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:44.303654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:44.321454 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 163/337] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:44.349215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:44.442025 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 175/338] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:13:44.714050 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e5ef-58f7-48fa-aad6-8fa01c0d57a6 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:44.714775 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e5ef-58f7-48fa-aad6-8fa01c0d57a6 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:44.715307 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25e5ef-58f7-48fa-aad6-8fa01c0d57a6 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:44.717403 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 164/339] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:44.724188 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570e4a8-e41f-4d9d-b782-f0425f8e29be None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:44.724475 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570e4a8-e41f-4d9d-b782-f0425f8e29be None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:44.724777 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1570e4a8-e41f-4d9d-b782-f0425f8e29be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:44.749742 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-1570e4a8-e41f-4d9d-b782-f0425f8e29be None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:44.750975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-1570e4a8-e41f-4d9d-b782-f0425f8e29be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:44.837184 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 176/340] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:45.055074 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e5ef-58f7-48fa-aad6-8fa01c0d57a6 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:45.082667 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570e4a8-e41f-4d9d-b782-f0425f8e29be None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:45.243292 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25e5ef-58f7-48fa-aad6-8fa01c0d57a6 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:45.280101 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:45.330005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ae35f-a644-489e-8bf1-90241defde10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:45.331041 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ae35f-a644-489e-8bf1-90241defde10 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:45.331610 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ae35f-a644-489e-8bf1-90241defde10 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:45.332093 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ae35f-a644-489e-8bf1-90241defde10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:45.342939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1570e4a8-e41f-4d9d-b782-f0425f8e29be None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:45.361483 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ae35f-a644-489e-8bf1-90241defde10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-198ae35f-a644-489e-8bf1-90241defde10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:45.367112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:45.368061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:45.376358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:45.376358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:45.376358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:45.376358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:45.376358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:45.376358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:45.376358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:45.376358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:45.376358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:45.376358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:45.376358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:45.376358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:45.377761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 165/341] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:13:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:45.381611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ae35f-a644-489e-8bf1-90241defde10 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:45.437903 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448397a-ac33-47a5-a956-9ddb4b17874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:45.438687 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448397a-ac33-47a5-a956-9ddb4b17874e None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:45.438973 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448397a-ac33-47a5-a956-9ddb4b17874e None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:45.439286 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448397a-ac33-47a5-a956-9ddb4b17874e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:45.463202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448397a-ac33-47a5-a956-9ddb4b17874e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-3448397a-ac33-47a5-a956-9ddb4b17874e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:45.470030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:45.471187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:45.472266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:45.472266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:45.472266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:45.472266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:45.472266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:45.472266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:45.472266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:45.472266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:45.472266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:45.472266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:45.472266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:45.472266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:45.472266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 177/342] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:45.478681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448397a-ac33-47a5-a956-9ddb4b17874e None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:45.501982 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:45.621457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448397a-ac33-47a5-a956-9ddb4b17874e None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:45.642910 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ae35f-a644-489e-8bf1-90241defde10 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:45.668273 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448af76-d1e4-4768-8bdd-45a379a5f180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:45.669177 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448af76-d1e4-4768-8bdd-45a379a5f180 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:45.669635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448af76-d1e4-4768-8bdd-45a379a5f180 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:45.670138 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448af76-d1e4-4768-8bdd-45a379a5f180 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:45.671094 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448af76-d1e4-4768-8bdd-45a379a5f180 None admin] RBAC: Adding query filter params (name=member) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:45.672462 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448af76-d1e4-4768-8bdd-45a379a5f180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:45.674857 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448af76-d1e4-4768-8bdd-45a379a5f180 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:45.693391 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 178/343] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:45.694703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448af76-d1e4-4768-8bdd-45a379a5f180 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:45.707242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:45.727290 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9be1b-24c2-4506-967d-935a2bf864bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:45.728199 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9be1b-24c2-4506-967d-935a2bf864bb None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:45.728642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9be1b-24c2-4506-967d-935a2bf864bb None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:45.729079 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9be1b-24c2-4506-967d-935a2bf864bb None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:45.732630 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9be1b-24c2-4506-967d-935a2bf864bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:45.734765 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9be1b-24c2-4506-967d-935a2bf864bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:45.736388 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9be1b-24c2-4506-967d-935a2bf864bb None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:45.757646 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 166/344] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:13:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:45.757646 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9be1b-24c2-4506-967d-935a2bf864bb None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:45.863597 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448af76-d1e4-4768-8bdd-45a379a5f180 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:45.879295 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9be1b-24c2-4506-967d-935a2bf864bb None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:45.894543 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:45.905670 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdb1283-6d00-436b-9c07-0657a6fa0eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:45.906621 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb1283-6d00-436b-9c07-0657a6fa0eb9 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:45.910000 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb1283-6d00-436b-9c07-0657a6fa0eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:45.910000 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdb1283-6d00-436b-9c07-0657a6fa0eb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:45.922823 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdb1283-6d00-436b-9c07-0657a6fa0eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:45.924115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e994c0-e150-45f9-9669-5cd56a786c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:45.925332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e994c0-e150-45f9-9669-5cd56a786c1d None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:45.925332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e994c0-e150-45f9-9669-5cd56a786c1d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:45.925332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e994c0-e150-45f9-9669-5cd56a786c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-4cdb1283-6d00-436b-9c07-0657a6fa0eb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:45.931323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:45.932404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:45.933829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:45.933829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:45.933829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:45.933829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:45.933829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:45.933829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:45.933829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:45.933829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:45.933829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:45.933829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:45.933829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:45.933829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:45.934952 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 179/345] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:45.936161 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e34b4-8e1b-47ed-8cc7-df5fd02bb6d8 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:45.936467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e34b4-8e1b-47ed-8cc7-df5fd02bb6d8 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:45.936759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e34b4-8e1b-47ed-8cc7-df5fd02bb6d8 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:45.941942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 180/346] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:45.942602 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e34b4-8e1b-47ed-8cc7-df5fd02bb6d8 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:46.022363 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:46.029751 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e994c0-e150-45f9-9669-5cd56a786c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:46.036065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e994c0-e150-45f9-9669-5cd56a786c1d None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:46.076763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e34b4-8e1b-47ed-8cc7-df5fd02bb6d8 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:46.143234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafdc4d-4273-4404-b8ca-371974743cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:46.144887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafdc4d-4273-4404-b8ca-371974743cd8 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:46.145382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafdc4d-4273-4404-b8ca-371974743cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:46.148592 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafdc4d-4273-4404-b8ca-371974743cd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:46.187526 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 167/347] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:46.188474 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e994c0-e150-45f9-9669-5cd56a786c1d None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:46.210655 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:46.261474 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafdc4d-4273-4404-b8ca-371974743cd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:46.263891 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafdc4d-4273-4404-b8ca-371974743cd8 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:46.337820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e994c0-e150-45f9-9669-5cd56a786c1d None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:46.343397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:46.393145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd258b11-68c1-4b4b-b709-9e968d5d6f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:46.394067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd258b11-68c1-4b4b-b709-9e968d5d6f8e None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:46.394495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd258b11-68c1-4b4b-b709-9e968d5d6f8e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:46.394934 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd258b11-68c1-4b4b-b709-9e968d5d6f8e None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:46.395748 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd258b11-68c1-4b4b-b709-9e968d5d6f8e None admin] RBAC: Adding query filter params (name=member) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:46.396209 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd258b11-68c1-4b4b-b709-9e968d5d6f8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:46.397880 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd258b11-68c1-4b4b-b709-9e968d5d6f8e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:46.398942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 181/348] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:46.400319 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030a1b-4832-48a9-a9b5-2c612bd9af1d None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:46.400636 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030a1b-4832-48a9-a9b5-2c612bd9af1d None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:46.400917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11030a1b-4832-48a9-a9b5-2c612bd9af1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:46.407906 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 168/349] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:46.409501 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ede492-0bcb-4fb8-ade6-41237d594848 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:46.410018 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ede492-0bcb-4fb8-ade6-41237d594848 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:46.410295 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ede492-0bcb-4fb8-ade6-41237d594848 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:46.411582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 169/350] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:46.412298 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ede492-0bcb-4fb8-ade6-41237d594848 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:46.424779 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-11030a1b-4832-48a9-a9b5-2c612bd9af1d None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:46.425977 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-11030a1b-4832-48a9-a9b5-2c612bd9af1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:46.509550 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:46.514720 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 182/351] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:46.516800 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd3a88-5709-4ee3-aef4-f45161679918 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:46.516800 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd3a88-5709-4ee3-aef4-f45161679918 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:46.521038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd3a88-5709-4ee3-aef4-f45161679918 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:46.522798 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 183/352] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:46.523611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd3a88-5709-4ee3-aef4-f45161679918 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:46.548983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ede492-0bcb-4fb8-ade6-41237d594848 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:46.599417 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15bdde-4534-43a2-b150-76632d651826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:46.600065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15bdde-4534-43a2-b150-76632d651826 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:46.600346 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15bdde-4534-43a2-b150-76632d651826 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:46.600656 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15bdde-4534-43a2-b150-76632d651826 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:46.601935 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15bdde-4534-43a2-b150-76632d651826 None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:46.603397 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15bdde-4534-43a2-b150-76632d651826 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:46.605137 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 170/353] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:46 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:46.605931 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15bdde-4534-43a2-b150-76632d651826 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:46.660852 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:46.674459 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd3a88-5709-4ee3-aef4-f45161679918 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:46.718844 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd8d0f-0869-4e03-a63a-41aa9831fc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:46.720209 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8d0f-0869-4e03-a63a-41aa9831fc28 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:46.720491 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8d0f-0869-4e03-a63a-41aa9831fc28 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:46.720876 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8d0f-0869-4e03-a63a-41aa9831fc28 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:46.721997 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd8d0f-0869-4e03-a63a-41aa9831fc28 None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:46.723457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd8d0f-0869-4e03-a63a-41aa9831fc28 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:46.725410 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 184/354] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:46 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:46.728967 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dceb6-7306-4e24-a934-5b10168bb4e5 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:46.728967 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dceb6-7306-4e24-a934-5b10168bb4e5 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:46.728967 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514dceb6-7306-4e24-a934-5b10168bb4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:46.752570 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-514dceb6-7306-4e24-a934-5b10168bb4e5 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:46.754972 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-514dceb6-7306-4e24-a934-5b10168bb4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:46.763088 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15bdde-4534-43a2-b150-76632d651826 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:46.811631 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfaadb-5fe1-4c6a-89e4-f57b84befbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:46.812248 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfaadb-5fe1-4c6a-89e4-f57b84befbf7 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:46.812554 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfaadb-5fe1-4c6a-89e4-f57b84befbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:46.812814 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfaadb-5fe1-4c6a-89e4-f57b84befbf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:46.826742 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:46.840894 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 185/355] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:46.842256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f04f6-d15e-4c1f-9d3d-d5651fc01b56 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:46.842618 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f04f6-d15e-4c1f-9d3d-d5651fc01b56 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:46.842974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f04f6-d15e-4c1f-9d3d-d5651fc01b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:46.866283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-1c6f04f6-d15e-4c1f-9d3d-d5651fc01b56 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:46.867676 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-1c6f04f6-d15e-4c1f-9d3d-d5651fc01b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:46.902184 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfaadb-5fe1-4c6a-89e4-f57b84befbf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:46.903691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dfaadb-5fe1-4c6a-89e4-f57b84befbf7 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:46.958978 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 186/356] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:46.959799 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f04f6-d15e-4c1f-9d3d-d5651fc01b56 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:46.989299 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:47.037827 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 171/357] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:47.039301 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfaadb-5fe1-4c6a-89e4-f57b84befbf7 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:47.096255 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:47.106120 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f04f6-d15e-4c1f-9d3d-d5651fc01b56 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:47.164288 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e41d9e-b9be-468f-95dc-b515bda10949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:47.164288 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41d9e-b9be-468f-95dc-b515bda10949 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:47.164288 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41d9e-b9be-468f-95dc-b515bda10949 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:47.164645 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e41d9e-b9be-468f-95dc-b515bda10949 None admin] PATH_INFO: `/v3/groups/5c55f5ff9b5340b181b46165fbf0f264` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:47.175179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfaadb-5fe1-4c6a-89e4-f57b84befbf7 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:47.175549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e41d9e-b9be-468f-95dc-b515bda10949 None admin] RBAC: Authorizing `identity:get_group(group_id=5c55f5ff9b5340b181b46165fbf0f264)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:47.177080 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e41d9e-b9be-468f-95dc-b515bda10949 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:47.180045 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 187/358] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:46 2022] GET /identity/v3/groups/5c55f5ff9b5340b181b46165fbf0f264 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:47.180979 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e41d9e-b9be-468f-95dc-b515bda10949 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:47.217660 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8bcbf-53f7-404e-a95b-af5dad0bb368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:47.218732 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8bcbf-53f7-404e-a95b-af5dad0bb368 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:47.219275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8bcbf-53f7-404e-a95b-af5dad0bb368 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:47.219804 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8bcbf-53f7-404e-a95b-af5dad0bb368 None admin] PATH_INFO: `/v3/groups/5c55f5ff9b5340b181b46165fbf0f264` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:47.221301 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8bcbf-53f7-404e-a95b-af5dad0bb368 None admin] RBAC: Authorizing `identity:get_group(group_id=5c55f5ff9b5340b181b46165fbf0f264)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:47.223174 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8bcbf-53f7-404e-a95b-af5dad0bb368 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:47.225534 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 172/359] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:47 2022] GET /identity/v3/groups/5c55f5ff9b5340b181b46165fbf0f264 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:47.226660 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8bcbf-53f7-404e-a95b-af5dad0bb368 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:47.302046 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:47.322392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e41d9e-b9be-468f-95dc-b515bda10949 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:47.367565 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8bcbf-53f7-404e-a95b-af5dad0bb368 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:47.376278 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e459b83-b65d-4057-b4dd-a75bcc38094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:47.378037 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e459b83-b65d-4057-b4dd-a75bcc38094e None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:47.378483 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e459b83-b65d-4057-b4dd-a75bcc38094e None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:47.378769 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e459b83-b65d-4057-b4dd-a75bcc38094e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:47.380814 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:47.392198 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e459b83-b65d-4057-b4dd-a75bcc38094e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-1e459b83-b65d-4057-b4dd-a75bcc38094e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:47.397975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:47.398982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:47.400043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:47.400043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:47.400043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:47.400043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:47.400043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:47.400043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:47.400043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:47.400043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:47.400043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:47.400043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:47.400043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:47.400043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:47.400043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 188/360] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:13:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:47.400868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e459b83-b65d-4057-b4dd-a75bcc38094e None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:47.412127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34c3f2-fc0a-4e40-98da-716d794ea8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:47.412999 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34c3f2-fc0a-4e40-98da-716d794ea8fa None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:47.413142 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34c3f2-fc0a-4e40-98da-716d794ea8fa None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:47.413337 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34c3f2-fc0a-4e40-98da-716d794ea8fa None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:47.414658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34c3f2-fc0a-4e40-98da-716d794ea8fa None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:47.416166 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34c3f2-fc0a-4e40-98da-716d794ea8fa None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:47.418763 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 173/361] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:47 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:47.419473 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34c3f2-fc0a-4e40-98da-716d794ea8fa None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:47.539558 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e459b83-b65d-4057-b4dd-a75bcc38094e None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:47.540945 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34c3f2-fc0a-4e40-98da-716d794ea8fa None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:47.585220 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8cad-dc3e-41be-8708-d61f3e079619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:47.585836 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8cad-dc3e-41be-8708-d61f3e079619 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:47.586997 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8cad-dc3e-41be-8708-d61f3e079619 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:47.586997 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8cad-dc3e-41be-8708-d61f3e079619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:47.587156 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf8cad-dc3e-41be-8708-d61f3e079619 None admin] RBAC: Adding query filter params (group.id=5c55f5ff9b5340b181b46165fbf0f264, role.id=b7001437cbb84adc825e214c44d6e551, scope.project.id=b54c43bcbc404d39884c37ef65b10c56) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:47.587407 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf8cad-dc3e-41be-8708-d61f3e079619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:47.590103 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf8cad-dc3e-41be-8708-d61f3e079619 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:47.591092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637dd9a6-8641-48bd-83c5-ac1bc0708b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:47.591700 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dd9a6-8641-48bd-83c5-ac1bc0708b32 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:47.591978 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dd9a6-8641-48bd-83c5-ac1bc0708b32 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:47.592248 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dd9a6-8641-48bd-83c5-ac1bc0708b32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:47.592996 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637dd9a6-8641-48bd-83c5-ac1bc0708b32 None admin] RBAC: Adding query filter params (group.id=5c55f5ff9b5340b181b46165fbf0f264, role.id=753aa4902b7544299c8bed1f59c1153e, scope.project.id=b54c43bcbc404d39884c37ef65b10c56) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:47.593303 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637dd9a6-8641-48bd-83c5-ac1bc0708b32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:47.594799 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637dd9a6-8641-48bd-83c5-ac1bc0708b32 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:47.599045 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 189/362] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Sep 3 21:13:47 2022] GET /identity/v3/role_assignments?group.id=5c55f5ff9b5340b181b46165fbf0f264&scope.project.id=b54c43bcbc404d39884c37ef65b10c56&role.id=b7001437cbb84adc825e214c44d6e551 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:47.599904 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8cad-dc3e-41be-8708-d61f3e079619 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:47.605302 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 174/363] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Sep 3 21:13:47 2022] GET /identity/v3/role_assignments?group.id=5c55f5ff9b5340b181b46165fbf0f264&scope.project.id=b54c43bcbc404d39884c37ef65b10c56&role.id=753aa4902b7544299c8bed1f59c1153e => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:47.605302 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637dd9a6-8641-48bd-83c5-ac1bc0708b32 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:47.625686 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:47.669326 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:47.761798 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637dd9a6-8641-48bd-83c5-ac1bc0708b32 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:47.762368 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8cad-dc3e-41be-8708-d61f3e079619 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:47.812765 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529415e-0651-4998-a791-e6876a0c4f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:47.813335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529415e-0651-4998-a791-e6876a0c4f89 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:47.813611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529415e-0651-4998-a791-e6876a0c4f89 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:47.814435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529415e-0651-4998-a791-e6876a0c4f89 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:47.833258 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529415e-0651-4998-a791-e6876a0c4f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:47.833454 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd3a7d-4655-423d-9f70-055a038cbe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:47.839035 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd3a7d-4655-423d-9f70-055a038cbe0c None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:47.839035 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd3a7d-4655-423d-9f70-055a038cbe0c None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:47.839035 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd3a7d-4655-423d-9f70-055a038cbe0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-e529415e-0651-4998-a791-e6876a0c4f89 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:47.840354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:47.841273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:47.842115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:47.842115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:47.842115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:47.842115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:47.842115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:47.842115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:47.842115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:47.842115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:47.842115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:47.842115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:47.842115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 03 21:13:47.842115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:47.842115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 175/364] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:47.842803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529415e-0651-4998-a791-e6876a0c4f89 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:47.856326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd3a7d-4655-423d-9f70-055a038cbe0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-79fd3a7d-4655-423d-9f70-055a038cbe0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:47.863456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:47.864781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:47.865822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:47.865822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:47.865822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:47.865822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:47.865822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:47.865822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:47.865822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:47.865822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:47.865822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:47.865822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:47.865822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:47.865822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:47.867922 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 190/365] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:13:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:47.868961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd3a7d-4655-423d-9f70-055a038cbe0c None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:47.964259 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529415e-0651-4998-a791-e6876a0c4f89 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:47.965801 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:47.980920 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:48.006836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e314e58-1f8a-4947-891c-e9239a57558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:48.007543 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e314e58-1f8a-4947-891c-e9239a57558f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:48.007893 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e314e58-1f8a-4947-891c-e9239a57558f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:48.008210 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e314e58-1f8a-4947-891c-e9239a57558f None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:48.009015 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e314e58-1f8a-4947-891c-e9239a57558f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:48.009381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e314e58-1f8a-4947-891c-e9239a57558f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:48.009752 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd3a7d-4655-423d-9f70-055a038cbe0c None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:48.011536 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e314e58-1f8a-4947-891c-e9239a57558f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:48.023264 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 176/366] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:13:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:48.024454 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e314e58-1f8a-4947-891c-e9239a57558f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:48.062923 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316176b-478d-45f4-a0b9-623e25a43631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:48.063521 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316176b-478d-45f4-a0b9-623e25a43631 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:48.064240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316176b-478d-45f4-a0b9-623e25a43631 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:48.064587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316176b-478d-45f4-a0b9-623e25a43631 None admin] PATH_INFO: `/v3/groups/5c55f5ff9b5340b181b46165fbf0f264` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:48.067248 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316176b-478d-45f4-a0b9-623e25a43631 None admin] RBAC: Authorizing `identity:get_group(group_id=5c55f5ff9b5340b181b46165fbf0f264)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:48.069089 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316176b-478d-45f4-a0b9-623e25a43631 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:48.072359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 191/367] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:47 2022] GET /identity/v3/groups/5c55f5ff9b5340b181b46165fbf0f264 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:48.074156 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316176b-478d-45f4-a0b9-623e25a43631 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:48.161645 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e314e58-1f8a-4947-891c-e9239a57558f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:48.209468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316176b-478d-45f4-a0b9-623e25a43631 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:48.219489 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21f6e0-956e-453f-880f-de65e1972629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:48.220139 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f6e0-956e-453f-880f-de65e1972629 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:48.224457 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f6e0-956e-453f-880f-de65e1972629 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:48.224782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f6e0-956e-453f-880f-de65e1972629 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:48.225462 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21f6e0-956e-453f-880f-de65e1972629 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:48.225767 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21f6e0-956e-453f-880f-de65e1972629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:48.227187 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21f6e0-956e-453f-880f-de65e1972629 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:48.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 177/368] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:48.247422 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21f6e0-956e-453f-880f-de65e1972629 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:48.270393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9dc399-ba26-430b-95ae-b56bfb036f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:48.271578 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dc399-ba26-430b-95ae-b56bfb036f7c None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:48.272069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dc399-ba26-430b-95ae-b56bfb036f7c None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:48.272549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9dc399-ba26-430b-95ae-b56bfb036f7c None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:48.273398 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9dc399-ba26-430b-95ae-b56bfb036f7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:48.273887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9dc399-ba26-430b-95ae-b56bfb036f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:48.275471 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9dc399-ba26-430b-95ae-b56bfb036f7c None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:48.278347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:48.285215 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:48.288573 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 192/369] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:48.288573 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9dc399-ba26-430b-95ae-b56bfb036f7c None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:48.384785 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21f6e0-956e-453f-880f-de65e1972629 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:48.411302 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9dc399-ba26-430b-95ae-b56bfb036f7c None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:48.431139 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9847b63-76f1-4af1-851c-b19a684709f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:48.432008 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9847b63-76f1-4af1-851c-b19a684709f1 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:48.432858 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9847b63-76f1-4af1-851c-b19a684709f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:48.433193 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9847b63-76f1-4af1-851c-b19a684709f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:48.455961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1a6ea-e58e-4dc7-b663-6ecb547d6cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:48.456642 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1a6ea-e58e-4dc7-b663-6ecb547d6cf9 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:48.456928 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1a6ea-e58e-4dc7-b663-6ecb547d6cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:48.457194 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1a6ea-e58e-4dc7-b663-6ecb547d6cf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:48.458050 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1a6ea-e58e-4dc7-b663-6ecb547d6cf9 None admin] RBAC: Adding query filter params (group.id=5c55f5ff9b5340b181b46165fbf0f264, role.id=b7001437cbb84adc825e214c44d6e551, scope.project.id=c68a6eefe1c74e299927c4592703857d) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:48.458466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1a6ea-e58e-4dc7-b663-6ecb547d6cf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:48.460003 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1a6ea-e58e-4dc7-b663-6ecb547d6cf9 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:48.466845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 193/370] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Sep 3 21:13:48 2022] GET /identity/v3/role_assignments?group.id=5c55f5ff9b5340b181b46165fbf0f264&scope.project.id=c68a6eefe1c74e299927c4592703857d&role.id=b7001437cbb84adc825e214c44d6e551 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:48.467701 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1a6ea-e58e-4dc7-b663-6ecb547d6cf9 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:48.545988 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:48.551582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9847b63-76f1-4af1-851c-b19a684709f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:48.553616 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9847b63-76f1-4af1-851c-b19a684709f1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:48.595896 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1a6ea-e58e-4dc7-b663-6ecb547d6cf9 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:48.606793 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:48.644876 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156c199-2ceb-43e5-9743-75ae27bdbf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:48.645449 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c199-2ceb-43e5-9743-75ae27bdbf3f None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:48.645729 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c199-2ceb-43e5-9743-75ae27bdbf3f None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:48.646001 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156c199-2ceb-43e5-9743-75ae27bdbf3f None admin] PATH_INFO: `/v3/users/15a941c50d594e58b032955772b8a042` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:48.652557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156c199-2ceb-43e5-9743-75ae27bdbf3f None admin] RBAC: Authorizing `identity:get_user(user_id=15a941c50d594e58b032955772b8a042)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:48.652557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2156c199-2ceb-43e5-9743-75ae27bdbf3f None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:48.652557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 194/371] 10.222.0.43 () {56 vars in 1177 bytes} [Sat Sep 3 21:13:48 2022] GET /identity/v3/users/15a941c50d594e58b032955772b8a042 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:48.652557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156c199-2ceb-43e5-9743-75ae27bdbf3f None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:48.773030 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 178/372] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:48.774108 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9847b63-76f1-4af1-851c-b19a684709f1 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:48.797177 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2156c199-2ceb-43e5-9743-75ae27bdbf3f None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:48.831383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:48.839871 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e68bb-e1b1-423e-94bd-5cc5602ae306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:48.840755 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e68bb-e1b1-423e-94bd-5cc5602ae306 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:48.841042 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e68bb-e1b1-423e-94bd-5cc5602ae306 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:48.844208 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e68bb-e1b1-423e-94bd-5cc5602ae306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:48.926665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e68bb-e1b1-423e-94bd-5cc5602ae306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:48.928050 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e68bb-e1b1-423e-94bd-5cc5602ae306 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:49.029061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9847b63-76f1-4af1-851c-b19a684709f1 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:49.049031 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 195/373] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:49.049954 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e68bb-e1b1-423e-94bd-5cc5602ae306 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:49.110470 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:49.119998 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa6af3-59c9-4c1c-b909-cd134e0bc4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:49.124144 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa6af3-59c9-4c1c-b909-cd134e0bc4b2 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:49.124277 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:49.124358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa6af3-59c9-4c1c-b909-cd134e0bc4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:49.124358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa6af3-59c9-4c1c-b909-cd134e0bc4b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:49.124358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa6af3-59c9-4c1c-b909-cd134e0bc4b2 None admin] RBAC: Adding query filter params (role.id=46aa5e1d5e704ae78369f7707f6977dc, user.id=15a941c50d594e58b032955772b8a042, scope.system=all) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:49.124358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa6af3-59c9-4c1c-b909-cd134e0bc4b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:49.124358 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa6af3-59c9-4c1c-b909-cd134e0bc4b2 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:49.137687 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 179/374] 10.222.0.43 () {56 vars in 1308 bytes} [Sat Sep 3 21:13:48 2022] GET /identity/v3/role_assignments?user.id=15a941c50d594e58b032955772b8a042&scope.system=all&role.id=46aa5e1d5e704ae78369f7707f6977dc => generated 510 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:49.138650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa6af3-59c9-4c1c-b909-cd134e0bc4b2 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:49.179705 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e68bb-e1b1-423e-94bd-5cc5602ae306 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:49.226565 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f369024-159a-4f1c-8070-69ec3fe4bb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:49.227482 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f369024-159a-4f1c-8070-69ec3fe4bb2d None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:49.227828 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f369024-159a-4f1c-8070-69ec3fe4bb2d None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:49.228135 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f369024-159a-4f1c-8070-69ec3fe4bb2d None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:49.229895 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f369024-159a-4f1c-8070-69ec3fe4bb2d None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:49.231457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f369024-159a-4f1c-8070-69ec3fe4bb2d None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:49.235071 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 196/375] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:49 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:49.242414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f369024-159a-4f1c-8070-69ec3fe4bb2d None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:49.385903 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:49.390597 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f369024-159a-4f1c-8070-69ec3fe4bb2d None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:49.407585 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa6af3-59c9-4c1c-b909-cd134e0bc4b2 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:49.435566 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cc00c-cfda-4102-b749-5148ceb5ff82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:49.436272 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cc00c-cfda-4102-b749-5148ceb5ff82 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:49.436432 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cc00c-cfda-4102-b749-5148ceb5ff82 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:49.436672 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515cc00c-cfda-4102-b749-5148ceb5ff82 None admin] PATH_INFO: `/v3/groups/5c55f5ff9b5340b181b46165fbf0f264` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:49.438049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cc00c-cfda-4102-b749-5148ceb5ff82 None admin] RBAC: Authorizing `identity:get_group(group_id=5c55f5ff9b5340b181b46165fbf0f264)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:49.439863 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515cc00c-cfda-4102-b749-5148ceb5ff82 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:49.442129 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 197/376] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:49 2022] GET /identity/v3/groups/5c55f5ff9b5340b181b46165fbf0f264 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:49.448427 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cc00c-cfda-4102-b749-5148ceb5ff82 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:49.498267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b331a45-dc8c-43bd-bb34-9d62e03f9b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:49.498920 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b331a45-dc8c-43bd-bb34-9d62e03f9b12 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:49.499200 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b331a45-dc8c-43bd-bb34-9d62e03f9b12 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:49.499472 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b331a45-dc8c-43bd-bb34-9d62e03f9b12 None admin] PATH_INFO: `/v3/projects/a2e3df601a7e4116a238ebd2db036ed5` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:49.501796 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b331a45-dc8c-43bd-bb34-9d62e03f9b12 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e3df601a7e4116a238ebd2db036ed5)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:49.503520 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b331a45-dc8c-43bd-bb34-9d62e03f9b12 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:49.505325 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 180/377] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:49 2022] GET /identity/v3/projects/a2e3df601a7e4116a238ebd2db036ed5 => generated 344 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:49.511346 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b331a45-dc8c-43bd-bb34-9d62e03f9b12 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:49.581066 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:49.587168 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515cc00c-cfda-4102-b749-5148ceb5ff82 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:49.634906 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e1275-85b6-423e-acd7-aeadbc36c014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:49.636102 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1275-85b6-423e-acd7-aeadbc36c014 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:49.636390 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1275-85b6-423e-acd7-aeadbc36c014 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:49.636698 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1275-85b6-423e-acd7-aeadbc36c014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:49.637421 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e1275-85b6-423e-acd7-aeadbc36c014 None admin] RBAC: Adding query filter params (group.id=5c55f5ff9b5340b181b46165fbf0f264, role.id=753aa4902b7544299c8bed1f59c1153e, scope.project.id=c68a6eefe1c74e299927c4592703857d) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:49.637779 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e1275-85b6-423e-acd7-aeadbc36c014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:49.639336 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e1275-85b6-423e-acd7-aeadbc36c014 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:49.646504 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 198/378] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Sep 3 21:13:49 2022] GET /identity/v3/role_assignments?group.id=5c55f5ff9b5340b181b46165fbf0f264&scope.project.id=c68a6eefe1c74e299927c4592703857d&role.id=753aa4902b7544299c8bed1f59c1153e => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:49.654345 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b331a45-dc8c-43bd-bb34-9d62e03f9b12 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:49.695631 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258314b4-457e-4fcf-8b1e-fb61c5f9469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:49.696194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258314b4-457e-4fcf-8b1e-fb61c5f9469d None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:49.696473 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258314b4-457e-4fcf-8b1e-fb61c5f9469d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:49.696773 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258314b4-457e-4fcf-8b1e-fb61c5f9469d None admin] PATH_INFO: `/v3/groups/6ae7f972a6104b38a348ee99dae43a10` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:49.704715 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258314b4-457e-4fcf-8b1e-fb61c5f9469d None admin] RBAC: Authorizing `identity:get_group(group_id=6ae7f972a6104b38a348ee99dae43a10)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:49.706196 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258314b4-457e-4fcf-8b1e-fb61c5f9469d None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:49.708254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 181/379] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:49 2022] GET /identity/v3/groups/6ae7f972a6104b38a348ee99dae43a10 => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:49.714515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e1275-85b6-423e-acd7-aeadbc36c014 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:49.774530 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:49.874191 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e1275-85b6-423e-acd7-aeadbc36c014 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:49.917986 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b0609-b93a-4869-9837-b282eb0cf1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:49.918634 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b0609-b93a-4869-9837-b282eb0cf1da None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:49.918918 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b0609-b93a-4869-9837-b282eb0cf1da None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:49.919192 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b0609-b93a-4869-9837-b282eb0cf1da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:49.919920 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b0609-b93a-4869-9837-b282eb0cf1da None admin] RBAC: Adding query filter params (group.id=6ae7f972a6104b38a348ee99dae43a10, role.id=a1c22a1558c34c1d9d262bf1da31887e, scope.project.id=a2e3df601a7e4116a238ebd2db036ed5) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:49.920226 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b0609-b93a-4869-9837-b282eb0cf1da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:49.921818 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b0609-b93a-4869-9837-b282eb0cf1da None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:49.928457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 199/380] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Sep 3 21:13:49 2022] GET /identity/v3/role_assignments?group.id=6ae7f972a6104b38a348ee99dae43a10&scope.project.id=a2e3df601a7e4116a238ebd2db036ed5&role.id=a1c22a1558c34c1d9d262bf1da31887e => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:50.454724 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293ec57-84d6-4978-a475-504bc9b13a86 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:50.455232 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293ec57-84d6-4978-a475-504bc9b13a86 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:50.455308 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293ec57-84d6-4978-a475-504bc9b13a86 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:50.456940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 182/381] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:50.463674 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e4c73-c303-469b-99bd-7c2fa31155b3 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:50.464187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e4c73-c303-469b-99bd-7c2fa31155b3 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:50.464619 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e4c73-c303-469b-99bd-7c2fa31155b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:50.489537 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-ca7e4c73-c303-469b-99bd-7c2fa31155b3 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:50.490789 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-ca7e4c73-c303-469b-99bd-7c2fa31155b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:50.575027 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 200/382] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:50.676039 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664cdd0-17d3-4ac2-985e-27ef3048f51f None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:50.676360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664cdd0-17d3-4ac2-985e-27ef3048f51f None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:50.676637 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664cdd0-17d3-4ac2-985e-27ef3048f51f None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:50.678498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 183/383] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:50.683935 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e0d76-6b77-4d5a-985d-61ae212517da None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:50.684216 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e0d76-6b77-4d5a-985d-61ae212517da None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:50.684573 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e0d76-6b77-4d5a-985d-61ae212517da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:50.713070 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-529e0d76-6b77-4d5a-985d-61ae212517da None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:50.714335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-529e0d76-6b77-4d5a-985d-61ae212517da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:50.741930 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:50.801108 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 201/384] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:50.971604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664cdd0-17d3-4ac2-985e-27ef3048f51f None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:51.101250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664cdd0-17d3-4ac2-985e-27ef3048f51f None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:51.119181 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:51.139245 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70c546-8cc6-406c-b2d8-516e91b00351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:51.139953 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70c546-8cc6-406c-b2d8-516e91b00351 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:51.140236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70c546-8cc6-406c-b2d8-516e91b00351 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:51.140511 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70c546-8cc6-406c-b2d8-516e91b00351 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:51.153702 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70c546-8cc6-406c-b2d8-516e91b00351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-ff70c546-8cc6-406c-b2d8-516e91b00351 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:51.158903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:51.159809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:51.160642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:51.160642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:51.160642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:51.160642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:51.160642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:51.160642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:51.160642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:51.160642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:51.160642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:51.160642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:51.160642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:51.160642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:51.163709 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 184/385] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:13:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:51.169633 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e0d76-6b77-4d5a-985d-61ae212517da None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:51.324670 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e0d76-6b77-4d5a-985d-61ae212517da None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:51.368089 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353bbd0-caf0-4f44-a0e3-9d48b287af71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:51.368736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353bbd0-caf0-4f44-a0e3-9d48b287af71 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:51.373627 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353bbd0-caf0-4f44-a0e3-9d48b287af71 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:51.373627 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353bbd0-caf0-4f44-a0e3-9d48b287af71 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:51.373627 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353bbd0-caf0-4f44-a0e3-9d48b287af71 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:51.373627 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353bbd0-caf0-4f44-a0e3-9d48b287af71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:51.373627 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353bbd0-caf0-4f44-a0e3-9d48b287af71 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:51.389184 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 202/386] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:13:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:51.394965 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70c546-8cc6-406c-b2d8-516e91b00351 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:51.434587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c1b58-9208-4c32-8bc3-9bd44f9c481a None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:51.435219 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c1b58-9208-4c32-8bc3-9bd44f9c481a None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:51.435694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c1b58-9208-4c32-8bc3-9bd44f9c481a None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:51.437351 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 203/387] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:13:51.443930 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e3f11-ac3e-4fb9-bde5-944c443b88c3 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:51.444490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e3f11-ac3e-4fb9-bde5-944c443b88c3 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:51.445019 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e3f11-ac3e-4fb9-bde5-944c443b88c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:51.473858 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-ab9e3f11-ac3e-4fb9-bde5-944c443b88c3 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:51.475907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-ab9e3f11-ac3e-4fb9-bde5-944c443b88c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:51.493523 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:51.559354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70c546-8cc6-406c-b2d8-516e91b00351 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:51.574828 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 204/388] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:13:51.574828 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e3f11-ac3e-4fb9-bde5-944c443b88c3 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:51.673927 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47bcfe-e87a-4f1b-b9b4-09a3986602a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:51.674883 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47bcfe-e87a-4f1b-b9b4-09a3986602a0 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:51.675177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47bcfe-e87a-4f1b-b9b4-09a3986602a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:51.675454 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47bcfe-e87a-4f1b-b9b4-09a3986602a0 None admin] PATH_INFO: `/v3/groups/5c55f5ff9b5340b181b46165fbf0f264` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:51.676660 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47bcfe-e87a-4f1b-b9b4-09a3986602a0 None admin] RBAC: Authorizing `identity:get_group(group_id=5c55f5ff9b5340b181b46165fbf0f264)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:51.678534 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b47bcfe-e87a-4f1b-b9b4-09a3986602a0 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:51.680301 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 185/389] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:51 2022] GET /identity/v3/groups/5c55f5ff9b5340b181b46165fbf0f264 => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:51.689503 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47bcfe-e87a-4f1b-b9b4-09a3986602a0 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:51.691273 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e3f11-ac3e-4fb9-bde5-944c443b88c3 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:51.765406 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd679f9-dcc0-4780-871b-f36904fb00e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:51.766097 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd679f9-dcc0-4780-871b-f36904fb00e7 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:51.766382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd679f9-dcc0-4780-871b-f36904fb00e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:51.766659 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd679f9-dcc0-4780-871b-f36904fb00e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:51.776087 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:51.797626 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd679f9-dcc0-4780-871b-f36904fb00e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-5cd679f9-dcc0-4780-871b-f36904fb00e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:51.802767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:51.803759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:51.804692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:51.804692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:51.804692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:51.804692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:51.804692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:51.804692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:51.804692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:51.804692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:51.804692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:51.804692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:51.804692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:51.804692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:51.808822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 205/390] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:51.814741 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd679f9-dcc0-4780-871b-f36904fb00e7 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:51.831409 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:51.863708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47bcfe-e87a-4f1b-b9b4-09a3986602a0 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:51.945928 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047da91-4389-42da-8c82-74357b3868a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:51.946582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047da91-4389-42da-8c82-74357b3868a6 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:51.946864 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047da91-4389-42da-8c82-74357b3868a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:51.947143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047da91-4389-42da-8c82-74357b3868a6 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:51.948582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047da91-4389-42da-8c82-74357b3868a6 None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:51.950119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047da91-4389-42da-8c82-74357b3868a6 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:51.952148 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 186/391] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:51 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:51.958096 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047da91-4389-42da-8c82-74357b3868a6 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:51.998962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd679f9-dcc0-4780-871b-f36904fb00e7 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:52.051044 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c236a-a7d8-4272-8911-cd74bbe68427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:52.051908 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c236a-a7d8-4272-8911-cd74bbe68427 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:52.052472 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c236a-a7d8-4272-8911-cd74bbe68427 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:52.052919 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c236a-a7d8-4272-8911-cd74bbe68427 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:52.054234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c236a-a7d8-4272-8911-cd74bbe68427 None admin] RBAC: Adding query filter params (name=member) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:52.054817 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c236a-a7d8-4272-8911-cd74bbe68427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:52.056908 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c236a-a7d8-4272-8911-cd74bbe68427 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:52.070345 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 206/392] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:52.071711 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c236a-a7d8-4272-8911-cd74bbe68427 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:52.081389 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047da91-4389-42da-8c82-74357b3868a6 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:52.101516 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:52.132285 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b0226-f21e-4957-b22e-b49c635ecaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:52.133332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b0226-f21e-4957-b22e-b49c635ecaa1 None admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:52.134423 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b0226-f21e-4957-b22e-b49c635ecaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:52.134911 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b0226-f21e-4957-b22e-b49c635ecaa1 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56/groups/5c55f5ff9b5340b181b46165fbf0f264/roles/753aa4902b7544299c8bed1f59c1153e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:52.139322 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b0226-f21e-4957-b22e-b49c635ecaa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=b54c43bcbc404d39884c37ef65b10c56, group_id=5c55f5ff9b5340b181b46165fbf0f264, role_id=753aa4902b7544299c8bed1f59c1153e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:52.141570 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b0226-f21e-4957-b22e-b49c635ecaa1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:52.151558 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:52.187669 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c236a-a7d8-4272-8911-cd74bbe68427 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:52.223039 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35cb3b-d9dc-4252-9dd9-844231582033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:52.223686 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35cb3b-d9dc-4252-9dd9-844231582033 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:52.224010 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35cb3b-d9dc-4252-9dd9-844231582033 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:52.224286 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35cb3b-d9dc-4252-9dd9-844231582033 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:52.240888 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 187/393] 10.222.0.43 () {58 vars in 1442 bytes} [Sat Sep 3 21:13:51 2022] PUT /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56/groups/5c55f5ff9b5340b181b46165fbf0f264/roles/753aa4902b7544299c8bed1f59c1153e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 21:13:52.241925 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35cb3b-d9dc-4252-9dd9-844231582033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:52.242475 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b0226-f21e-4957-b22e-b49c635ecaa1 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-ad35cb3b-d9dc-4252-9dd9-844231582033 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:52.256662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:52.257647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:52.258439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:52.258439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:52.258439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:52.258439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:52.258439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:52.258439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:52.258439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:52.258439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:52.258439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:52.258439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:52.258439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:52.258439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:52.258439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 207/394] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:52.261756 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35cb3b-d9dc-4252-9dd9-844231582033 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:52.410964 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b0226-f21e-4957-b22e-b49c635ecaa1 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:52.451103 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3cbc1-72c9-431b-a751-4c6bfd246424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:52.451753 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3cbc1-72c9-431b-a751-4c6bfd246424 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:52.452034 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3cbc1-72c9-431b-a751-4c6bfd246424 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:52.452310 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3cbc1-72c9-431b-a751-4c6bfd246424 None admin] PATH_INFO: `/v3/groups/5c55f5ff9b5340b181b46165fbf0f264` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:52.453568 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3cbc1-72c9-431b-a751-4c6bfd246424 None admin] RBAC: Authorizing `identity:get_group(group_id=5c55f5ff9b5340b181b46165fbf0f264)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:52.455043 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3cbc1-72c9-431b-a751-4c6bfd246424 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:52.457146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 188/395] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:52 2022] GET /identity/v3/groups/5c55f5ff9b5340b181b46165fbf0f264 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:52.468011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3cbc1-72c9-431b-a751-4c6bfd246424 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:52.501506 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35cb3b-d9dc-4252-9dd9-844231582033 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:52.527231 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:52.546098 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:52.555050 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4da2ee-1abe-4b7a-b15b-54691f8006e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:52.555660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4da2ee-1abe-4b7a-b15b-54691f8006e2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:52.555937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4da2ee-1abe-4b7a-b15b-54691f8006e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:52.556208 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4da2ee-1abe-4b7a-b15b-54691f8006e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:52.569312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4da2ee-1abe-4b7a-b15b-54691f8006e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:52.569312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4da2ee-1abe-4b7a-b15b-54691f8006e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:52.569312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4da2ee-1abe-4b7a-b15b-54691f8006e2 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:52.569312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 208/396] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:52.575169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4da2ee-1abe-4b7a-b15b-54691f8006e2 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:52.606081 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3cbc1-72c9-431b-a751-4c6bfd246424 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:52.676565 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837654f3-f2b3-4864-919e-f07fb3072791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:52.677544 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837654f3-f2b3-4864-919e-f07fb3072791 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:52.677965 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837654f3-f2b3-4864-919e-f07fb3072791 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:52.678398 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837654f3-f2b3-4864-919e-f07fb3072791 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:52.679746 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837654f3-f2b3-4864-919e-f07fb3072791 None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:52.681473 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837654f3-f2b3-4864-919e-f07fb3072791 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:52.688777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 189/397] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:52 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:52.697907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837654f3-f2b3-4864-919e-f07fb3072791 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:52.707155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4da2ee-1abe-4b7a-b15b-54691f8006e2 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:52.757868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caecf38-1db4-4379-a0fa-a0f1c9ca454d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:52.758749 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caecf38-1db4-4379-a0fa-a0f1c9ca454d None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:52.759171 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caecf38-1db4-4379-a0fa-a0f1c9ca454d None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:52.759871 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caecf38-1db4-4379-a0fa-a0f1c9ca454d None admin] PATH_INFO: `/v3/groups/5c55f5ff9b5340b181b46165fbf0f264` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:52.761368 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caecf38-1db4-4379-a0fa-a0f1c9ca454d None admin] RBAC: Authorizing `identity:get_group(group_id=5c55f5ff9b5340b181b46165fbf0f264)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:52.763154 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caecf38-1db4-4379-a0fa-a0f1c9ca454d None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:52.765400 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 209/398] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:52 2022] GET /identity/v3/groups/5c55f5ff9b5340b181b46165fbf0f264 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:52.766958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201f931-538f-4e27-8a2d-758ef6e9ffea None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:52.767437 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201f931-538f-4e27-8a2d-758ef6e9ffea None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:52.767896 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201f931-538f-4e27-8a2d-758ef6e9ffea None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:52.769610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 210/399] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:52.776509 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2a2f-31ab-4eab-b018-29d52dafd116 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:52.776509 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2a2f-31ab-4eab-b018-29d52dafd116 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:52.776841 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d2a2f-31ab-4eab-b018-29d52dafd116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:52.798063 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-962d2a2f-31ab-4eab-b018-29d52dafd116 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:52.799373 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-962d2a2f-31ab-4eab-b018-29d52dafd116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:52.828708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837654f3-f2b3-4864-919e-f07fb3072791 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:52.839301 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:52.862874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:52.868620 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe79341-33e4-4299-91ab-978ff9f59d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:52.870047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe79341-33e4-4299-91ab-978ff9f59d8a None admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:52.870520 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe79341-33e4-4299-91ab-978ff9f59d8a None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:52.870942 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe79341-33e4-4299-91ab-978ff9f59d8a None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56/groups/5c55f5ff9b5340b181b46165fbf0f264/roles/b7001437cbb84adc825e214c44d6e551` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:52.873180 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe79341-33e4-4299-91ab-978ff9f59d8a None admin] RBAC: Authorizing `identity:create_grant(project_id=b54c43bcbc404d39884c37ef65b10c56, group_id=5c55f5ff9b5340b181b46165fbf0f264, role_id=b7001437cbb84adc825e214c44d6e551)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:52.875727 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe79341-33e4-4299-91ab-978ff9f59d8a None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:52.884649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 211/400] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:52.886805 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d2a2f-31ab-4eab-b018-29d52dafd116 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:53.007707 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d2a2f-31ab-4eab-b018-29d52dafd116 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:53.048908 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c5ce6-cf69-4b12-bc29-89a9a98d73d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:53.049547 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c5ce6-cf69-4b12-bc29-89a9a98d73d3 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:53.049831 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c5ce6-cf69-4b12-bc29-89a9a98d73d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:53.050106 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c5ce6-cf69-4b12-bc29-89a9a98d73d3 None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:53.051253 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c5ce6-cf69-4b12-bc29-89a9a98d73d3 None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:53.052742 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c5ce6-cf69-4b12-bc29-89a9a98d73d3 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:53.054383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 212/401] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:52 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:53.055518 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d2a76-799d-4549-be03-fa5217446eaf None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:53.055867 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d2a76-799d-4549-be03-fa5217446eaf None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:53.056142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d2a76-799d-4549-be03-fa5217446eaf None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:53.057984 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 213/402] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:53.062879 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d2a76-799d-4549-be03-fa5217446eaf None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:53.066769 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 190/403] 10.222.0.43 () {58 vars in 1442 bytes} [Sat Sep 3 21:13:52 2022] PUT /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56/groups/5c55f5ff9b5340b181b46165fbf0f264/roles/b7001437cbb84adc825e214c44d6e551 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 21:13:53.068037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979ed0-6a47-4493-9eb6-a8dad333ea4a None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:53.068324 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979ed0-6a47-4493-9eb6-a8dad333ea4a None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:53.073220 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5979ed0-6a47-4493-9eb6-a8dad333ea4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:53.124762 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-b5979ed0-6a47-4493-9eb6-a8dad333ea4a None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:53.126015 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-b5979ed0-6a47-4493-9eb6-a8dad333ea4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:53.137005 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:53.191901 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d2a76-799d-4549-be03-fa5217446eaf None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:53.252815 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b113e-7478-43b2-8f99-1647abc09948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:53.253496 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b113e-7478-43b2-8f99-1647abc09948 None admin] REQUEST_METHOD: `PUT` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:53.253776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b113e-7478-43b2-8f99-1647abc09948 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:53.254049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b113e-7478-43b2-8f99-1647abc09948 None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d/groups/5c55f5ff9b5340b181b46165fbf0f264/roles/b7001437cbb84adc825e214c44d6e551` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:53.260687 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b113e-7478-43b2-8f99-1647abc09948 None admin] RBAC: Authorizing `identity:create_grant(project_id=c68a6eefe1c74e299927c4592703857d, group_id=5c55f5ff9b5340b181b46165fbf0f264, role_id=b7001437cbb84adc825e214c44d6e551)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:53.262347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b113e-7478-43b2-8f99-1647abc09948 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:53.283283 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 191/404] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:53.284548 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5979ed0-6a47-4493-9eb6-a8dad333ea4a None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:53.349427 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 214/405] 10.222.0.43 () {58 vars in 1442 bytes} [Sat Sep 3 21:13:53 2022] PUT /identity/v3/projects/c68a6eefe1c74e299927c4592703857d/groups/5c55f5ff9b5340b181b46165fbf0f264/roles/b7001437cbb84adc825e214c44d6e551 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:13:53.425332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:53.430026 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5979ed0-6a47-4493-9eb6-a8dad333ea4a None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:53.478180 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b314334-4709-48e9-b6fd-a8223a64f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:53.478957 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b314334-4709-48e9-b6fd-a8223a64f9b7 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:53.479329 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b314334-4709-48e9-b6fd-a8223a64f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:53.479628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b314334-4709-48e9-b6fd-a8223a64f9b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:53.497054 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b314334-4709-48e9-b6fd-a8223a64f9b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-9b314334-4709-48e9-b6fd-a8223a64f9b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:53.502287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:53.503217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:53.504002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:53.504002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:53.504002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:53.504002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:53.504002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:53.504002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:53.504002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:53.504002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:53.504002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:53.504002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:53.504002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:53.504002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:53.504002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 192/406] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:13:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:53.512136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b113e-7478-43b2-8f99-1647abc09948 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:53.654110 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b113e-7478-43b2-8f99-1647abc09948 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:53.673054 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:53.694759 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b314334-4709-48e9-b6fd-a8223a64f9b7 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:53.698528 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab05dd-4dc5-4701-aff3-664dcc4e0fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:53.699395 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab05dd-4dc5-4701-aff3-664dcc4e0fb2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:53.699868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab05dd-4dc5-4701-aff3-664dcc4e0fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:53.700327 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab05dd-4dc5-4701-aff3-664dcc4e0fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:53.701241 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab05dd-4dc5-4701-aff3-664dcc4e0fb2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:53.701886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab05dd-4dc5-4701-aff3-664dcc4e0fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:53.704337 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab05dd-4dc5-4701-aff3-664dcc4e0fb2 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:53.722914 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 215/407] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:13:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:53.729782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab05dd-4dc5-4701-aff3-664dcc4e0fb2 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:53.830895 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b314334-4709-48e9-b6fd-a8223a64f9b7 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:53.895990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81adb-22b1-4300-8da9-83f3b93653d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:53.896972 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81adb-22b1-4300-8da9-83f3b93653d8 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:53.897251 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81adb-22b1-4300-8da9-83f3b93653d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:53.897522 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81adb-22b1-4300-8da9-83f3b93653d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:53.923681 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f81adb-22b1-4300-8da9-83f3b93653d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-b4f81adb-22b1-4300-8da9-83f3b93653d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:53.937275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:53.938163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:53.938958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:53.938958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:53.938958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:53.938958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:53.938958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:53.938958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:53.938958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:53.938958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:53.938958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:53.938958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:53.938958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:53.938958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:53.941380 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 193/408] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:13:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:53.946996 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81adb-22b1-4300-8da9-83f3b93653d8 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:53.965305 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab05dd-4dc5-4701-aff3-664dcc4e0fb2 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:53.969955 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:54.064994 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760967e-0d9a-4dd0-9ccc-06d3e37f7811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:54.065624 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760967e-0d9a-4dd0-9ccc-06d3e37f7811 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:54.065901 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760967e-0d9a-4dd0-9ccc-06d3e37f7811 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:54.066172 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760967e-0d9a-4dd0-9ccc-06d3e37f7811 None admin] PATH_INFO: `/v3/groups/5c55f5ff9b5340b181b46165fbf0f264` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:54.067242 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81adb-22b1-4300-8da9-83f3b93653d8 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:54.067355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760967e-0d9a-4dd0-9ccc-06d3e37f7811 None admin] RBAC: Authorizing `identity:get_group(group_id=5c55f5ff9b5340b181b46165fbf0f264)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:54.079422 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760967e-0d9a-4dd0-9ccc-06d3e37f7811 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:54.079422 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 216/409] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:53 2022] GET /identity/v3/groups/5c55f5ff9b5340b181b46165fbf0f264 => generated 226 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:54.085377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760967e-0d9a-4dd0-9ccc-06d3e37f7811 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:54.108093 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a36505-22fa-4d55-92cb-8972085ac21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:54.108750 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a36505-22fa-4d55-92cb-8972085ac21c None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:54.109033 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a36505-22fa-4d55-92cb-8972085ac21c None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:54.109308 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a36505-22fa-4d55-92cb-8972085ac21c None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:54.110494 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a36505-22fa-4d55-92cb-8972085ac21c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:54.110494 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a36505-22fa-4d55-92cb-8972085ac21c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:54.111742 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a36505-22fa-4d55-92cb-8972085ac21c None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:54.121222 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 194/410] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:54.129645 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a36505-22fa-4d55-92cb-8972085ac21c None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:54.164724 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:54.249109 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:54.265645 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760967e-0d9a-4dd0-9ccc-06d3e37f7811 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:54.289975 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a36505-22fa-4d55-92cb-8972085ac21c None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:54.306855 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf8c41-c624-40d3-807f-9fbaec071568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:54.308054 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8c41-c624-40d3-807f-9fbaec071568 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:54.308331 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8c41-c624-40d3-807f-9fbaec071568 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:54.308633 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf8c41-c624-40d3-807f-9fbaec071568 None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:54.309965 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf8c41-c624-40d3-807f-9fbaec071568 None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:54.311594 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf8c41-c624-40d3-807f-9fbaec071568 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:54.318394 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 217/411] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:54 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:54.319908 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf8c41-c624-40d3-807f-9fbaec071568 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:54.358366 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb605a94-0848-49ba-9f35-265f31d3cef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:54.359412 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb605a94-0848-49ba-9f35-265f31d3cef4 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:54.359895 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb605a94-0848-49ba-9f35-265f31d3cef4 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:54.360366 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb605a94-0848-49ba-9f35-265f31d3cef4 None admin] PATH_INFO: `/v3/groups/6ae7f972a6104b38a348ee99dae43a10` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:54.365455 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb605a94-0848-49ba-9f35-265f31d3cef4 None admin] RBAC: Authorizing `identity:get_group(group_id=6ae7f972a6104b38a348ee99dae43a10)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:54.367367 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb605a94-0848-49ba-9f35-265f31d3cef4 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:54.370010 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 195/412] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:54 2022] GET /identity/v3/groups/6ae7f972a6104b38a348ee99dae43a10 => generated 229 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:54.384045 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb605a94-0848-49ba-9f35-265f31d3cef4 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:54.467884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf8c41-c624-40d3-807f-9fbaec071568 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:54.491710 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:54.530610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253c2f1-c24a-4f0c-9ffe-1aec7797c221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:54.532084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253c2f1-c24a-4f0c-9ffe-1aec7797c221 None admin] REQUEST_METHOD: `PUT` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:54.532694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253c2f1-c24a-4f0c-9ffe-1aec7797c221 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:54.533171 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253c2f1-c24a-4f0c-9ffe-1aec7797c221 None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d/groups/5c55f5ff9b5340b181b46165fbf0f264/roles/753aa4902b7544299c8bed1f59c1153e` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:54.538604 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253c2f1-c24a-4f0c-9ffe-1aec7797c221 None admin] RBAC: Authorizing `identity:create_grant(project_id=c68a6eefe1c74e299927c4592703857d, group_id=5c55f5ff9b5340b181b46165fbf0f264, role_id=753aa4902b7544299c8bed1f59c1153e)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:54.541402 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253c2f1-c24a-4f0c-9ffe-1aec7797c221 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:54.556466 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb605a94-0848-49ba-9f35-265f31d3cef4 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:54.595567 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a610d-d09e-499b-9aa2-1d7ef58942e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:54.596701 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a610d-d09e-499b-9aa2-1d7ef58942e1 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:54.597224 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a610d-d09e-499b-9aa2-1d7ef58942e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:54.597656 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a610d-d09e-499b-9aa2-1d7ef58942e1 None admin] PATH_INFO: `/v3/projects/a2e3df601a7e4116a238ebd2db036ed5` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:54.599034 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a610d-d09e-499b-9aa2-1d7ef58942e1 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e3df601a7e4116a238ebd2db036ed5)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:54.600702 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a610d-d09e-499b-9aa2-1d7ef58942e1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:54.602870 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 196/413] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:54 2022] GET /identity/v3/projects/a2e3df601a7e4116a238ebd2db036ed5 => generated 344 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:54.609616 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a610d-d09e-499b-9aa2-1d7ef58942e1 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:54.629786 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:54.675094 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 218/414] 10.222.0.43 () {58 vars in 1442 bytes} [Sat Sep 3 21:13:54 2022] PUT /identity/v3/projects/c68a6eefe1c74e299927c4592703857d/groups/5c55f5ff9b5340b181b46165fbf0f264/roles/753aa4902b7544299c8bed1f59c1153e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 21:13:54.738829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a610d-d09e-499b-9aa2-1d7ef58942e1 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:54.792774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6638da-bbad-490e-b19e-6c5581a8f4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:54.793528 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6638da-bbad-490e-b19e-6c5581a8f4f5 None admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:54.793814 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6638da-bbad-490e-b19e-6c5581a8f4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:54.794097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6638da-bbad-490e-b19e-6c5581a8f4f5 None admin] PATH_INFO: `/v3/projects/a2e3df601a7e4116a238ebd2db036ed5/groups/6ae7f972a6104b38a348ee99dae43a10/roles/a1c22a1558c34c1d9d262bf1da31887e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:54.796209 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6638da-bbad-490e-b19e-6c5581a8f4f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2e3df601a7e4116a238ebd2db036ed5, group_id=6ae7f972a6104b38a348ee99dae43a10, role_id=a1c22a1558c34c1d9d262bf1da31887e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:54.797792 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6638da-bbad-490e-b19e-6c5581a8f4f5 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:54.870837 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 197/415] 10.222.0.43 () {58 vars in 1442 bytes} [Sat Sep 3 21:13:54 2022] PUT /identity/v3/projects/a2e3df601a7e4116a238ebd2db036ed5/groups/6ae7f972a6104b38a348ee99dae43a10/roles/a1c22a1558c34c1d9d262bf1da31887e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:13:55.068953 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062e964-6021-4607-b99e-03c884ec7b91 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:55.069290 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062e964-6021-4607-b99e-03c884ec7b91 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:55.069517 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062e964-6021-4607-b99e-03c884ec7b91 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:55.071362 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 219/416] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:55.078549 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231955c9-e319-46f3-a8b1-e49923bd0a31 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:55.078869 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231955c9-e319-46f3-a8b1-e49923bd0a31 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:55.079052 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231955c9-e319-46f3-a8b1-e49923bd0a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:55.103286 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-231955c9-e319-46f3-a8b1-e49923bd0a31 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:55.105140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-231955c9-e319-46f3-a8b1-e49923bd0a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:55.192062 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 198/417] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:55.550568 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062e964-6021-4607-b99e-03c884ec7b91 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:55.665560 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062e964-6021-4607-b99e-03c884ec7b91 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:55.706551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbade3-c91c-4483-873a-25986a890a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:55.707180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbade3-c91c-4483-873a-25986a890a70 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:55.707462 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbade3-c91c-4483-873a-25986a890a70 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:55.707733 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbade3-c91c-4483-873a-25986a890a70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:55.730367 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbade3-c91c-4483-873a-25986a890a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-05bbade3-c91c-4483-873a-25986a890a70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:55.735430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:55.736392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:55.737227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:55.737227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:55.737227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:55.737227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:55.737227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:55.737227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:55.737227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:55.737227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:55.737227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:55.737227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:55.737227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:55.737227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:55.737227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 220/418] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:13:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:55.742825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231955c9-e319-46f3-a8b1-e49923bd0a31 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:55.769359 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:55.861507 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231955c9-e319-46f3-a8b1-e49923bd0a31 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:55.902151 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bdd91-ef91-42e0-9f8a-87ea31860e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:55.902774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bdd91-ef91-42e0-9f8a-87ea31860e1b None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:55.903047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bdd91-ef91-42e0-9f8a-87ea31860e1b None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:55.903316 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bdd91-ef91-42e0-9f8a-87ea31860e1b None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:55.903987 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bdd91-ef91-42e0-9f8a-87ea31860e1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:55.904289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bdd91-ef91-42e0-9f8a-87ea31860e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:55.905731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bdd91-ef91-42e0-9f8a-87ea31860e1b None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:55.915737 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 199/419] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:13:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:55.922312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbade3-c91c-4483-873a-25986a890a70 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:55.963516 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:56.076038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbade3-c91c-4483-873a-25986a890a70 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:56.136466 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4140fd3-600e-436f-9e90-80683b770f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:56.137703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140fd3-600e-436f-9e90-80683b770f84 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:56.138190 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140fd3-600e-436f-9e90-80683b770f84 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:56.138663 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4140fd3-600e-436f-9e90-80683b770f84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:56.214839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f03d0-61df-4ec9-ace5-9b1dbb2e9b54 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:56.215201 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f03d0-61df-4ec9-ace5-9b1dbb2e9b54 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:56.215470 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f03d0-61df-4ec9-ace5-9b1dbb2e9b54 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:56.217179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 200/420] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:56.225125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd881778-dd66-4617-bda1-231f6fa97d81 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:56.225398 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd881778-dd66-4617-bda1-231f6fa97d81 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:56.225671 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd881778-dd66-4617-bda1-231f6fa97d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:56.241619 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4140fd3-600e-436f-9e90-80683b770f84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:56.243426 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4140fd3-600e-436f-9e90-80683b770f84 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:56.262314 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-bd881778-dd66-4617-bda1-231f6fa97d81 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:56.264007 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-bd881778-dd66-4617-bda1-231f6fa97d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:56.289259 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:56.340990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:56.348170 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 201/421] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:56.349951 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4fa24-7253-4f32-94e8-d57a3fee41f4 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:56.350477 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4fa24-7253-4f32-94e8-d57a3fee41f4 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:56.350962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4fa24-7253-4f32-94e8-d57a3fee41f4 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:56.352667 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 202/422] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:56.359475 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947403b0-4bdc-477d-9095-245f70923c7f None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:56.360071 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947403b0-4bdc-477d-9095-245f70923c7f None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:56.360577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947403b0-4bdc-477d-9095-245f70923c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:56.384248 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-947403b0-4bdc-477d-9095-245f70923c7f None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:56.386102 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-947403b0-4bdc-477d-9095-245f70923c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:56.401202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 221/423] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:56.406150 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4140fd3-600e-436f-9e90-80683b770f84 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:56.507307 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 203/424] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:56.535961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4140fd3-600e-436f-9e90-80683b770f84 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:56.580051 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3004b2-9773-4a36-9d02-17f7648ebcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:56.581481 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3004b2-9773-4a36-9d02-17f7648ebcc5 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:56.581957 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3004b2-9773-4a36-9d02-17f7648ebcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:56.582404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3004b2-9773-4a36-9d02-17f7648ebcc5 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:56.589398 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3004b2-9773-4a36-9d02-17f7648ebcc5 None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:56.591099 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3004b2-9773-4a36-9d02-17f7648ebcc5 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:56.593314 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 222/425] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:56 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:56.598806 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947403b0-4bdc-477d-9095-245f70923c7f None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:56.725438 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947403b0-4bdc-477d-9095-245f70923c7f None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:56.754123 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:56.757101 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3004b2-9773-4a36-9d02-17f7648ebcc5 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:56.760848 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:56.769650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb641a96-7961-48d9-a9d8-23cd3b5322a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:56.770292 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb641a96-7961-48d9-a9d8-23cd3b5322a4 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:56.770570 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb641a96-7961-48d9-a9d8-23cd3b5322a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:56.770901 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb641a96-7961-48d9-a9d8-23cd3b5322a4 None admin] PATH_INFO: `/v3/groups/5c55f5ff9b5340b181b46165fbf0f264` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:56.774804 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb641a96-7961-48d9-a9d8-23cd3b5322a4 None admin] RBAC: Authorizing `identity:get_group(group_id=5c55f5ff9b5340b181b46165fbf0f264)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:56.778961 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb641a96-7961-48d9-a9d8-23cd3b5322a4 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:56.778961 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 204/426] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:56 2022] GET /identity/v3/groups/5c55f5ff9b5340b181b46165fbf0f264 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:56.784116 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb641a96-7961-48d9-a9d8-23cd3b5322a4 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:56.932624 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3004b2-9773-4a36-9d02-17f7648ebcc5 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:56.937833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb641a96-7961-48d9-a9d8-23cd3b5322a4 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:56.997864 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cbf97-8e76-45ac-a3b8-2e79ad19b226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:56.999018 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cbf97-8e76-45ac-a3b8-2e79ad19b226 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:57.000901 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cbf97-8e76-45ac-a3b8-2e79ad19b226 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:57.001870 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cbf97-8e76-45ac-a3b8-2e79ad19b226 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:57.005817 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6872ac7-6a4d-4c85-b495-16c7fe7c8028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:57.006919 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6872ac7-6a4d-4c85-b495-16c7fe7c8028 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:57.008113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6872ac7-6a4d-4c85-b495-16c7fe7c8028 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:57.013341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6872ac7-6a4d-4c85-b495-16c7fe7c8028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:57.014136 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6872ac7-6a4d-4c85-b495-16c7fe7c8028 None admin] RBAC: Adding query filter params (group.id=5c55f5ff9b5340b181b46165fbf0f264, role.id=753aa4902b7544299c8bed1f59c1153e, scope.project.id=b54c43bcbc404d39884c37ef65b10c56) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:57.014451 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6872ac7-6a4d-4c85-b495-16c7fe7c8028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:57.015956 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6872ac7-6a4d-4c85-b495-16c7fe7c8028 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:57.023835 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 205/427] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Sep 3 21:13:56 2022] GET /identity/v3/role_assignments?group.id=5c55f5ff9b5340b181b46165fbf0f264&scope.project.id=b54c43bcbc404d39884c37ef65b10c56&role.id=753aa4902b7544299c8bed1f59c1153e => generated 611 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:57.024792 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6872ac7-6a4d-4c85-b495-16c7fe7c8028 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:57.027182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9cbf97-8e76-45ac-a3b8-2e79ad19b226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-0b9cbf97-8e76-45ac-a3b8-2e79ad19b226 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:57.033352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:57.034309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:57.035159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:57.035159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:57.035159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:57.035159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:57.035159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:57.035159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:57.035159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:57.035159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:57.035159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:57.035159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:57.035159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:57.035159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:57.038165 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 223/428] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:57.045519 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cbf97-8e76-45ac-a3b8-2e79ad19b226 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:57.176504 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:57.180888 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:57.251913 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6872ac7-6a4d-4c85-b495-16c7fe7c8028 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:57.275069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cbf97-8e76-45ac-a3b8-2e79ad19b226 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:57.308467 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f4d65-1592-449d-8d59-53155a6c4062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:57.309257 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f4d65-1592-449d-8d59-53155a6c4062 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:57.309684 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f4d65-1592-449d-8d59-53155a6c4062 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:57.309961 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f4d65-1592-449d-8d59-53155a6c4062 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:57.321510 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f1786-17b6-4ee5-b721-cbe88e1a4f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:57.322191 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f1786-17b6-4ee5-b721-cbe88e1a4f06 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:57.322543 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f1786-17b6-4ee5-b721-cbe88e1a4f06 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:57.322838 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f1786-17b6-4ee5-b721-cbe88e1a4f06 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:57.323486 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f4d65-1592-449d-8d59-53155a6c4062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:57.323876 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f1786-17b6-4ee5-b721-cbe88e1a4f06 None admin] RBAC: Adding query filter params (name=member) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:57.324188 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f1786-17b6-4ee5-b721-cbe88e1a4f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:57.327908 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f1786-17b6-4ee5-b721-cbe88e1a4f06 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-798f4d65-1592-449d-8d59-53155a6c4062 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:57.329143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:57.330020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:57.330815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:57.330815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:57.330815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:57.330815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:57.330815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:57.330815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:57.330815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:57.330815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:57.330815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:57.330815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:57.330815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 03 21:13:57.330815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:57.331880 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 206/429] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:13:57.337035 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f4d65-1592-449d-8d59-53155a6c4062 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:57.337799 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 224/430] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:57.344576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f1786-17b6-4ee5-b721-cbe88e1a4f06 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:57.472167 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f1786-17b6-4ee5-b721-cbe88e1a4f06 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:57.491452 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f4d65-1592-449d-8d59-53155a6c4062 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:57.504061 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:57.518603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eca230-6f61-4da3-8769-da8bdfa68692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:57.519274 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eca230-6f61-4da3-8769-da8bdfa68692 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:57.519551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eca230-6f61-4da3-8769-da8bdfa68692 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:57.519827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eca230-6f61-4da3-8769-da8bdfa68692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:57.533219 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:57.553901 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedbbeb-5723-49d4-8bd8-e14821a06ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:57.554469 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedbbeb-5723-49d4-8bd8-e14821a06ce8 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:57.554754 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedbbeb-5723-49d4-8bd8-e14821a06ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:57.555029 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedbbeb-5723-49d4-8bd8-e14821a06ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:57.555712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedbbeb-5723-49d4-8bd8-e14821a06ce8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:57.556032 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedbbeb-5723-49d4-8bd8-e14821a06ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:57.559775 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedbbeb-5723-49d4-8bd8-e14821a06ce8 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:57.570774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 207/431] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:13:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:57.579912 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedbbeb-5723-49d4-8bd8-e14821a06ce8 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:57.618974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eca230-6f61-4da3-8769-da8bdfa68692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:57.621631 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eca230-6f61-4da3-8769-da8bdfa68692 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:57.698374 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedbbeb-5723-49d4-8bd8-e14821a06ce8 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:57.733722 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 225/432] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 21:13:57.740126 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eca230-6f61-4da3-8769-da8bdfa68692 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:57.741514 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457da5e-70c4-4f40-b1ef-b1881bba7901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:57.742127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457da5e-70c4-4f40-b1ef-b1881bba7901 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:57.742447 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457da5e-70c4-4f40-b1ef-b1881bba7901 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:57.742744 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457da5e-70c4-4f40-b1ef-b1881bba7901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:57.769494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:57.804507 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:57.828745 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457da5e-70c4-4f40-b1ef-b1881bba7901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:57.830733 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457da5e-70c4-4f40-b1ef-b1881bba7901 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:57.857676 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eca230-6f61-4da3-8769-da8bdfa68692 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:57.896627 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3289ced-bd25-4650-a14b-77ad36b51ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:57.897210 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3289ced-bd25-4650-a14b-77ad36b51ae2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:57.897491 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3289ced-bd25-4650-a14b-77ad36b51ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:57.897764 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3289ced-bd25-4650-a14b-77ad36b51ae2 None admin] PATH_INFO: `/v3/projects/b54c43bcbc404d39884c37ef65b10c56` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:57.898884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3289ced-bd25-4650-a14b-77ad36b51ae2 None admin] RBAC: Authorizing `identity:get_project(project_id=b54c43bcbc404d39884c37ef65b10c56)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:57.900326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3289ced-bd25-4650-a14b-77ad36b51ae2 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:57.907510 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 226/433] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:57 2022] GET /identity/v3/projects/b54c43bcbc404d39884c37ef65b10c56 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:57.907510 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5361e3-6344-4942-bf6a-60738e8145f1 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:57.907510 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5361e3-6344-4942-bf6a-60738e8145f1 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:57.907510 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5361e3-6344-4942-bf6a-60738e8145f1 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:57.907510 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 227/434] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:57.908409 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5361e3-6344-4942-bf6a-60738e8145f1 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:57.955360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 208/435] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:13:57.956654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16f6e2-dd6f-4002-90ae-400abb1461da None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:57.956943 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16f6e2-dd6f-4002-90ae-400abb1461da None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:57.957217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16f6e2-dd6f-4002-90ae-400abb1461da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:57.976673 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-be16f6e2-dd6f-4002-90ae-400abb1461da None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:57.977941 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-be16f6e2-dd6f-4002-90ae-400abb1461da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:58.009447 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:58.019459 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5361e3-6344-4942-bf6a-60738e8145f1 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:58.051958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 209/436] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:58.052811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16f6e2-dd6f-4002-90ae-400abb1461da None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:58.068505 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:58.070898 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f2aa5-d4c0-4a41-8af1-97dd27c7fed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:58.071563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f2aa5-d4c0-4a41-8af1-97dd27c7fed7 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:58.071847 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f2aa5-d4c0-4a41-8af1-97dd27c7fed7 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:58.072132 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f2aa5-d4c0-4a41-8af1-97dd27c7fed7 None admin] PATH_INFO: `/v3/groups/5c55f5ff9b5340b181b46165fbf0f264` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:58.074090 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f2aa5-d4c0-4a41-8af1-97dd27c7fed7 None admin] RBAC: Authorizing `identity:get_group(group_id=5c55f5ff9b5340b181b46165fbf0f264)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:58.075751 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f2aa5-d4c0-4a41-8af1-97dd27c7fed7 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:58.077527 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 228/437] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:57 2022] GET /identity/v3/groups/5c55f5ff9b5340b181b46165fbf0f264 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:58.086210 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faa5b4-00e4-40fd-a40a-f030abcd17d8 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:58.086495 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faa5b4-00e4-40fd-a40a-f030abcd17d8 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:58.086771 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faa5b4-00e4-40fd-a40a-f030abcd17d8 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:58.092417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 229/438] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:13:58.092417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faa5b4-00e4-40fd-a40a-f030abcd17d8 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:58.176056 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16f6e2-dd6f-4002-90ae-400abb1461da None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:58.209348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faa5b4-00e4-40fd-a40a-f030abcd17d8 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:58.215392 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a60a3-a170-40da-abfa-fd94c163d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:58.216089 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a60a3-a170-40da-abfa-fd94c163d8aa None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:58.216372 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a60a3-a170-40da-abfa-fd94c163d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:58.216678 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a60a3-a170-40da-abfa-fd94c163d8aa None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:58.217936 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a60a3-a170-40da-abfa-fd94c163d8aa None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:58.219379 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a60a3-a170-40da-abfa-fd94c163d8aa None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:58.221297 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 210/439] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:58 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:58.226202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7075-a00b-4bcc-a7f0-4a7712ec0a6c None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:58.226202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7075-a00b-4bcc-a7f0-4a7712ec0a6c None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:58.226202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7075-a00b-4bcc-a7f0-4a7712ec0a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:58.242100 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-436f7075-a00b-4bcc-a7f0-4a7712ec0a6c None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:13:58.243383 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-436f7075-a00b-4bcc-a7f0-4a7712ec0a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:13:58.253468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbf063-e14a-4621-b162-87c2c3874e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:58.254076 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbf063-e14a-4621-b162-87c2c3874e96 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:58.254565 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbf063-e14a-4621-b162-87c2c3874e96 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:58.254673 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbf063-e14a-4621-b162-87c2c3874e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:58.255376 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbf063-e14a-4621-b162-87c2c3874e96 None admin] RBAC: Adding query filter params (group.id=5c55f5ff9b5340b181b46165fbf0f264, role.id=b7001437cbb84adc825e214c44d6e551, scope.project.id=b54c43bcbc404d39884c37ef65b10c56) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:58.255689 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbf063-e14a-4621-b162-87c2c3874e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:58.257293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbf063-e14a-4621-b162-87c2c3874e96 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:58.264207 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 230/440] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Sep 3 21:13:58 2022] GET /identity/v3/role_assignments?group.id=5c55f5ff9b5340b181b46165fbf0f264&scope.project.id=b54c43bcbc404d39884c37ef65b10c56&role.id=b7001437cbb84adc825e214c44d6e551 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:58.265066 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbf063-e14a-4621-b162-87c2c3874e96 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:58.306040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:58.346421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 211/441] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:13:58.393098 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f7075-a00b-4bcc-a7f0-4a7712ec0a6c None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:58.407365 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:58.407715 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbf063-e14a-4621-b162-87c2c3874e96 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:58.449628 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51991f51-4bf3-465d-8a82-b0d52ce8f767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:58.450278 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51991f51-4bf3-465d-8a82-b0d52ce8f767 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:58.450580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51991f51-4bf3-465d-8a82-b0d52ce8f767 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:58.450970 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51991f51-4bf3-465d-8a82-b0d52ce8f767 None admin] PATH_INFO: `/v3/groups/5c55f5ff9b5340b181b46165fbf0f264` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:58.452057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51991f51-4bf3-465d-8a82-b0d52ce8f767 None admin] RBAC: Authorizing `identity:get_group(group_id=5c55f5ff9b5340b181b46165fbf0f264)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:58.453598 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51991f51-4bf3-465d-8a82-b0d52ce8f767 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:58.455281 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 231/442] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:58 2022] GET /identity/v3/groups/5c55f5ff9b5340b181b46165fbf0f264 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:58.461317 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51991f51-4bf3-465d-8a82-b0d52ce8f767 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:58.515640 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f7075-a00b-4bcc-a7f0-4a7712ec0a6c None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:58.555216 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6245c3-5583-4acc-a1d6-112e680b2297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:58.555861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6245c3-5583-4acc-a1d6-112e680b2297 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:58.556198 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6245c3-5583-4acc-a1d6-112e680b2297 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:58.556414 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6245c3-5583-4acc-a1d6-112e680b2297 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:58.570773 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6245c3-5583-4acc-a1d6-112e680b2297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-1d6245c3-5583-4acc-a1d6-112e680b2297 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:58.575833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:58.576805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:58.577845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:58.577845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:58.577845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:58.577845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:58.577845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:58.577845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:58.577845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:58.577845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:58.577845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:58.577845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:58.577845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:13:58.577845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:13:58.577845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 212/443] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:13:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:13:58.582878 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6245c3-5583-4acc-a1d6-112e680b2297 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:58.601453 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:58.609939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51991f51-4bf3-465d-8a82-b0d52ce8f767 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:58.655482 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19905d14-41e2-40f8-ba02-2b17901d85e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:58.656095 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19905d14-41e2-40f8-ba02-2b17901d85e5 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:58.656095 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19905d14-41e2-40f8-ba02-2b17901d85e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:58.656227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19905d14-41e2-40f8-ba02-2b17901d85e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:58.656936 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19905d14-41e2-40f8-ba02-2b17901d85e5 None admin] RBAC: Adding query filter params (group.id=5c55f5ff9b5340b181b46165fbf0f264, role.id=b7001437cbb84adc825e214c44d6e551, scope.project.id=c68a6eefe1c74e299927c4592703857d) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:58.657231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19905d14-41e2-40f8-ba02-2b17901d85e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:58.658799 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19905d14-41e2-40f8-ba02-2b17901d85e5 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:58.665000 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 232/444] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Sep 3 21:13:58 2022] GET /identity/v3/role_assignments?group.id=5c55f5ff9b5340b181b46165fbf0f264&scope.project.id=c68a6eefe1c74e299927c4592703857d&role.id=b7001437cbb84adc825e214c44d6e551 => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:58.681779 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19905d14-41e2-40f8-ba02-2b17901d85e5 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:58.688246 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:58.734751 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6245c3-5583-4acc-a1d6-112e680b2297 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:58.796093 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aba2eb-34eb-43e1-9abb-fa15ecf4e4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:58.797162 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aba2eb-34eb-43e1-9abb-fa15ecf4e4c2 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:58.797649 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aba2eb-34eb-43e1-9abb-fa15ecf4e4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:58.798154 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aba2eb-34eb-43e1-9abb-fa15ecf4e4c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:58.799056 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aba2eb-34eb-43e1-9abb-fa15ecf4e4c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:58.799580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aba2eb-34eb-43e1-9abb-fa15ecf4e4c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:58.801338 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aba2eb-34eb-43e1-9abb-fa15ecf4e4c2 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:58.815519 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 213/445] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:58.821906 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aba2eb-34eb-43e1-9abb-fa15ecf4e4c2 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:58.844042 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19905d14-41e2-40f8-ba02-2b17901d85e5 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:58.897874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97102ab9-841b-46ba-8494-5e2a8b789011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:58.898482 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97102ab9-841b-46ba-8494-5e2a8b789011 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:58.898764 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97102ab9-841b-46ba-8494-5e2a8b789011 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:58.899504 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97102ab9-841b-46ba-8494-5e2a8b789011 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:58.917237 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97102ab9-841b-46ba-8494-5e2a8b789011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-97102ab9-841b-46ba-8494-5e2a8b789011 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:13:58.926635 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:13:58.927580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:13:58.928417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:13:58.928417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:13:58.928417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:13:58.928417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:13:58.928417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:13:58.928417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:13:58.928417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:13:58.928417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:13:58.928417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:13:58.928417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:13:58.928417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 03 21:13:58.928417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:13:58.928417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 233/446] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:13:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:13:58.930274 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97102ab9-841b-46ba-8494-5e2a8b789011 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:58.953703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:58.988688 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aba2eb-34eb-43e1-9abb-fa15ecf4e4c2 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:59.028949 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:59.032560 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca494cc5-023f-4436-8770-f3433f5b9a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:59.033210 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494cc5-023f-4436-8770-f3433f5b9a15 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:59.033501 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494cc5-023f-4436-8770-f3433f5b9a15 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:59.033768 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494cc5-023f-4436-8770-f3433f5b9a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:59.086522 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97102ab9-841b-46ba-8494-5e2a8b789011 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:59.120423 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca494cc5-023f-4436-8770-f3433f5b9a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:59.121997 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca494cc5-023f-4436-8770-f3433f5b9a15 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:59.132734 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c850284-5a32-4b2c-a2dd-c2441101f7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:59.134272 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c850284-5a32-4b2c-a2dd-c2441101f7da None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:59.134272 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c850284-5a32-4b2c-a2dd-c2441101f7da None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:59.134272 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c850284-5a32-4b2c-a2dd-c2441101f7da None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:59.134784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c850284-5a32-4b2c-a2dd-c2441101f7da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:59.134938 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c850284-5a32-4b2c-a2dd-c2441101f7da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:59.136249 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c850284-5a32-4b2c-a2dd-c2441101f7da None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:59.149318 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 234/447] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:13:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:13:59.156370 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c850284-5a32-4b2c-a2dd-c2441101f7da None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:59.249056 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 214/448] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 21:13:59.250072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:59.254832 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca494cc5-023f-4436-8770-f3433f5b9a15 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:59.272024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c850284-5a32-4b2c-a2dd-c2441101f7da None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:59.285121 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:59.310264 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0638fe4-35e9-4e40-b81b-5fb79759debe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:59.310870 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0638fe4-35e9-4e40-b81b-5fb79759debe None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:59.311151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0638fe4-35e9-4e40-b81b-5fb79759debe None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:59.311429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0638fe4-35e9-4e40-b81b-5fb79759debe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:59.361391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca494cc5-023f-4436-8770-f3433f5b9a15 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:59.385418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0638fe4-35e9-4e40-b81b-5fb79759debe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:59.386939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0638fe4-35e9-4e40-b81b-5fb79759debe None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:59.399917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24964953-abf6-4c54-91d1-4ae975cb77c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:59.400874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24964953-abf6-4c54-91d1-4ae975cb77c0 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:59.401404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24964953-abf6-4c54-91d1-4ae975cb77c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:59.401404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24964953-abf6-4c54-91d1-4ae975cb77c0 None admin] PATH_INFO: `/v3/projects/a2e3df601a7e4116a238ebd2db036ed5` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:59.402363 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24964953-abf6-4c54-91d1-4ae975cb77c0 None admin] RBAC: Authorizing `identity:get_project(project_id=a2e3df601a7e4116a238ebd2db036ed5)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:59.403816 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24964953-abf6-4c54-91d1-4ae975cb77c0 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:59.405692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 215/449] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:59 2022] GET /identity/v3/projects/a2e3df601a7e4116a238ebd2db036ed5 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:59.411349 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24964953-abf6-4c54-91d1-4ae975cb77c0 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:59.465614 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:59.488390 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 235/450] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:13:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 03 21:13:59.494213 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0638fe4-35e9-4e40-b81b-5fb79759debe None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:59.512113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:59.515201 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24964953-abf6-4c54-91d1-4ae975cb77c0 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:59.550963 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875400b-cee5-4671-8c69-c67d52e4cf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:59.551596 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875400b-cee5-4671-8c69-c67d52e4cf3d None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:59.551871 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875400b-cee5-4671-8c69-c67d52e4cf3d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:59.552144 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875400b-cee5-4671-8c69-c67d52e4cf3d None admin] PATH_INFO: `/v3/groups/6ae7f972a6104b38a348ee99dae43a10` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:59.553601 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875400b-cee5-4671-8c69-c67d52e4cf3d None admin] RBAC: Authorizing `identity:get_group(group_id=6ae7f972a6104b38a348ee99dae43a10)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:59.555084 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875400b-cee5-4671-8c69-c67d52e4cf3d None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:59.556685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 216/451] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:59 2022] GET /identity/v3/groups/6ae7f972a6104b38a348ee99dae43a10 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:59.562996 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875400b-cee5-4671-8c69-c67d52e4cf3d None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:59.600001 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0638fe4-35e9-4e40-b81b-5fb79759debe None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:59.636261 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654c94a-334c-4359-a36a-878310a745e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:59.636921 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654c94a-334c-4359-a36a-878310a745e4 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:59.637201 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654c94a-334c-4359-a36a-878310a745e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:59.637473 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654c94a-334c-4359-a36a-878310a745e4 None admin] PATH_INFO: `/v3/projects/c68a6eefe1c74e299927c4592703857d` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:59.638602 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654c94a-334c-4359-a36a-878310a745e4 None admin] RBAC: Authorizing `identity:get_project(project_id=c68a6eefe1c74e299927c4592703857d)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:59.640056 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654c94a-334c-4359-a36a-878310a745e4 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:59.641725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 236/452] 10.222.0.43 () {56 vars in 1186 bytes} [Sat Sep 3 21:13:59 2022] GET /identity/v3/projects/c68a6eefe1c74e299927c4592703857d => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:59.647438 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654c94a-334c-4359-a36a-878310a745e4 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:59.668303 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875400b-cee5-4671-8c69-c67d52e4cf3d None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:59.699087 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:59.704700 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a3e14-c9e9-4b81-a43c-f131b1371434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:59.705305 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a3e14-c9e9-4b81-a43c-f131b1371434 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:59.705583 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a3e14-c9e9-4b81-a43c-f131b1371434 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:59.705854 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a3e14-c9e9-4b81-a43c-f131b1371434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:59.706621 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a3e14-c9e9-4b81-a43c-f131b1371434 None admin] RBAC: Adding query filter params (group.id=6ae7f972a6104b38a348ee99dae43a10, role.id=a1c22a1558c34c1d9d262bf1da31887e, scope.project.id=a2e3df601a7e4116a238ebd2db036ed5) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:59.706874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a3e14-c9e9-4b81-a43c-f131b1371434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:59.708315 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a3e14-c9e9-4b81-a43c-f131b1371434 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:59.714267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 217/453] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Sep 3 21:13:59 2022] GET /identity/v3/role_assignments?group.id=6ae7f972a6104b38a348ee99dae43a10&scope.project.id=a2e3df601a7e4116a238ebd2db036ed5&role.id=a1c22a1558c34c1d9d262bf1da31887e => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:59.762990 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654c94a-334c-4359-a36a-878310a745e4 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:59.800463 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb356624-f65e-47bf-be2f-2830dde7f514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:59.801137 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb356624-f65e-47bf-be2f-2830dde7f514 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:59.801416 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb356624-f65e-47bf-be2f-2830dde7f514 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:59.801687 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb356624-f65e-47bf-be2f-2830dde7f514 None admin] PATH_INFO: `/v3/groups/5c55f5ff9b5340b181b46165fbf0f264` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:59.802892 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb356624-f65e-47bf-be2f-2830dde7f514 None admin] RBAC: Authorizing `identity:get_group(group_id=5c55f5ff9b5340b181b46165fbf0f264)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:59.804356 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb356624-f65e-47bf-be2f-2830dde7f514 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:59.806206 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 237/454] 10.222.0.43 () {56 vars in 1180 bytes} [Sat Sep 3 21:13:59 2022] GET /identity/v3/groups/5c55f5ff9b5340b181b46165fbf0f264 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:13:59.812926 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a3e14-c9e9-4b81-a43c-f131b1371434 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:13:59.847666 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:13:59.924630 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a3e14-c9e9-4b81-a43c-f131b1371434 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:13:59.958448 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c28076-2f1f-4ace-af55-c587c26c63b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:13:59.959051 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c28076-2f1f-4ace-af55-c587c26c63b0 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:13:59.959325 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c28076-2f1f-4ace-af55-c587c26c63b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:13:59.959597 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c28076-2f1f-4ace-af55-c587c26c63b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:13:59.960315 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c28076-2f1f-4ace-af55-c587c26c63b0 None admin] RBAC: Adding query filter params (group.id=5c55f5ff9b5340b181b46165fbf0f264, role.id=753aa4902b7544299c8bed1f59c1153e, scope.project.id=c68a6eefe1c74e299927c4592703857d) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:13:59.960648 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c28076-2f1f-4ace-af55-c587c26c63b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:13:59.962104 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c28076-2f1f-4ace-af55-c587c26c63b0 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:13:59.974311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 218/455] 10.222.0.43 () {56 vars in 1376 bytes} [Sat Sep 3 21:13:59 2022] GET /identity/v3/role_assignments?group.id=5c55f5ff9b5340b181b46165fbf0f264&scope.project.id=c68a6eefe1c74e299927c4592703857d&role.id=753aa4902b7544299c8bed1f59c1153e => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:02.704866 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9fa28-9ffc-4934-b3fb-909377081928 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:02.705388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9fa28-9ffc-4934-b3fb-909377081928 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:02.705821 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9fa28-9ffc-4934-b3fb-909377081928 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:02.708549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 238/456] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:02.714566 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798dd11-b8b5-4b09-94bd-741e99ef648c None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:02.715510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798dd11-b8b5-4b09-94bd-741e99ef648c None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:02.715987 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798dd11-b8b5-4b09-94bd-741e99ef648c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:02.736506 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-d798dd11-b8b5-4b09-94bd-741e99ef648c None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:02.738363 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-d798dd11-b8b5-4b09-94bd-741e99ef648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:02.816782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 219/457] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:14:02.942241 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9f40b-0100-45af-8672-ee7cbc4057c6 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:02.942904 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9f40b-0100-45af-8672-ee7cbc4057c6 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:02.943371 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9f40b-0100-45af-8672-ee7cbc4057c6 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:02.945196 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 239/458] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:14:02.951097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e546d-e79c-491e-a748-31453d971a4e None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:02.951380 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e546d-e79c-491e-a748-31453d971a4e None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:02.951887 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e546d-e79c-491e-a748-31453d971a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:02.971929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-d06e546d-e79c-491e-a748-31453d971a4e None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:02.973499 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-d06e546d-e79c-491e-a748-31453d971a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:02.996196 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:03.051335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 220/459] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:03.054023 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f5cb2-d8c0-474b-b30d-082ed9a8a01a None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:03.054545 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f5cb2-d8c0-474b-b30d-082ed9a8a01a None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:03.055045 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f5cb2-d8c0-474b-b30d-082ed9a8a01a None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:03.056840 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 240/460] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:14:03.062416 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8c3bc-531b-413a-bdbb-7922d79164c7 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:03.062977 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8c3bc-531b-413a-bdbb-7922d79164c7 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:03.063452 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8c3bc-531b-413a-bdbb-7922d79164c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:03.082902 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-36f8c3bc-531b-413a-bdbb-7922d79164c7 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:03.084453 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-36f8c3bc-531b-413a-bdbb-7922d79164c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:03.161640 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 221/461] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:03.193655 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f5cb2-d8c0-474b-b30d-082ed9a8a01a None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:03.304727 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f5cb2-d8c0-474b-b30d-082ed9a8a01a None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:03.320896 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:03.342788 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0953ec-0e5d-4643-8824-18f3625637ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:03.343961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0953ec-0e5d-4643-8824-18f3625637ce None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:03.343961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0953ec-0e5d-4643-8824-18f3625637ce None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:03.344124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0953ec-0e5d-4643-8824-18f3625637ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:03.355488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0953ec-0e5d-4643-8824-18f3625637ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:03.357059 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0953ec-0e5d-4643-8824-18f3625637ce None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-cc0953ec-0e5d-4643-8824-18f3625637ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:03.374068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:03.375069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:03.375938 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:03.375938 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:03.375938 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:03.375938 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 241/462] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:03.382051 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8c3bc-531b-413a-bdbb-7922d79164c7 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:03.416827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0953ec-0e5d-4643-8824-18f3625637ce None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:03.483379 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:03.500853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8c3bc-531b-413a-bdbb-7922d79164c7 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:03.538136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0953ec-0e5d-4643-8824-18f3625637ce None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:03.543717 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf531c-cbc2-49ff-9db7-f60ee00f8676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:03.544342 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf531c-cbc2-49ff-9db7-f60ee00f8676 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:03.544651 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf531c-cbc2-49ff-9db7-f60ee00f8676 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:03.544923 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf531c-cbc2-49ff-9db7-f60ee00f8676 None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:03.545574 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf531c-cbc2-49ff-9db7-f60ee00f8676 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:03.545879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf531c-cbc2-49ff-9db7-f60ee00f8676 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:03.547302 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf531c-cbc2-49ff-9db7-f60ee00f8676 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:03.560466 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 222/463] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:03.565895 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf531c-cbc2-49ff-9db7-f60ee00f8676 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:03.584198 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea5c24-4cd8-4d65-af14-148396c3384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:03.585444 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea5c24-4cd8-4d65-af14-148396c3384a None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:03.585943 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea5c24-4cd8-4d65-af14-148396c3384a None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:03.586521 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea5c24-4cd8-4d65-af14-148396c3384a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:03.601245 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea5c24-4cd8-4d65-af14-148396c3384a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:03.603143 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea5c24-4cd8-4d65-af14-148396c3384a None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-e1ea5c24-4cd8-4d65-af14-148396c3384a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:03.620057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:03.621335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:03.622374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:03.622374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:03.622374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:03.622997 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 242/464] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:03.623838 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea5c24-4cd8-4d65-af14-148396c3384a None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:03.646742 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:03.682689 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf531c-cbc2-49ff-9db7-f60ee00f8676 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:03.721946 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec54f2-a3fc-45b6-8465-08925983fad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:03.722585 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec54f2-a3fc-45b6-8465-08925983fad8 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:03.722854 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec54f2-a3fc-45b6-8465-08925983fad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:03.723132 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec54f2-a3fc-45b6-8465-08925983fad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:03.735295 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec54f2-a3fc-45b6-8465-08925983fad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:03.736906 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec54f2-a3fc-45b6-8465-08925983fad8 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:03.743815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:03.744089 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea5c24-4cd8-4d65-af14-148396c3384a None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-68ec54f2-a3fc-45b6-8465-08925983fad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:03.754335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:03.755456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:03.756504 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:03.756504 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:03.756504 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:03.756504 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 223/465] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:03.756504 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec54f2-a3fc-45b6-8465-08925983fad8 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:03.787130 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591a236-4751-4a2f-bf97-a03d1654be8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:03.787731 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591a236-4751-4a2f-bf97-a03d1654be8d None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:03.788083 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591a236-4751-4a2f-bf97-a03d1654be8d None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:03.788359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591a236-4751-4a2f-bf97-a03d1654be8d None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:03.789072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591a236-4751-4a2f-bf97-a03d1654be8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:03.790574 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591a236-4751-4a2f-bf97-a03d1654be8d None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:03.873381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec54f2-a3fc-45b6-8465-08925983fad8 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:03.887434 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 243/466] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Sep 3 21:14:03 2022] POST /identity/v3/users => generated 246 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:14:03.888280 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591a236-4751-4a2f-bf97-a03d1654be8d None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:03.920222 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b45580-3360-460e-b577-f2c3d98fb087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:03.921217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b45580-3360-460e-b577-f2c3d98fb087 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:03.921721 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b45580-3360-460e-b577-f2c3d98fb087 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:03.922199 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b45580-3360-460e-b577-f2c3d98fb087 None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:03.923023 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b45580-3360-460e-b577-f2c3d98fb087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:03.923494 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b45580-3360-460e-b577-f2c3d98fb087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:03.925097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b45580-3360-460e-b577-f2c3d98fb087 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:03.944066 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 224/467] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:03.946730 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a818f0e-6cc4-4530-b17d-3fcb2282c929 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:03.946730 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a818f0e-6cc4-4530-b17d-3fcb2282c929 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:03.946730 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a818f0e-6cc4-4530-b17d-3fcb2282c929 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:03.948184 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 225/468] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:03.953320 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a818f0e-6cc4-4530-b17d-3fcb2282c929 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:04.005343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:04.037275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:04.041331 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591a236-4751-4a2f-bf97-a03d1654be8d None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:04.088136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f459e-5d45-44fc-8763-ae1eeab8f224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:04.089100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f459e-5d45-44fc-8763-ae1eeab8f224 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:04.089657 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f459e-5d45-44fc-8763-ae1eeab8f224 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:04.090591 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f459e-5d45-44fc-8763-ae1eeab8f224 None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:04.090805 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f459e-5d45-44fc-8763-ae1eeab8f224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:04.091284 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f459e-5d45-44fc-8763-ae1eeab8f224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:04.092623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f459e-5d45-44fc-8763-ae1eeab8f224 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:04.105315 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a818f0e-6cc4-4530-b17d-3fcb2282c929 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:04.106799 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 244/469] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:04.109522 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659e099-1faf-41c1-9deb-f9a2894bc335 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:04.117250 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659e099-1faf-41c1-9deb-f9a2894bc335 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:04.117250 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659e099-1faf-41c1-9deb-f9a2894bc335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:04.134512 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-6659e099-1faf-41c1-9deb-f9a2894bc335 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:04.134512 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-6659e099-1faf-41c1-9deb-f9a2894bc335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:04.158003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636ca8f-ca97-409e-a2ff-e84fb07dc796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:04.158625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636ca8f-ca97-409e-a2ff-e84fb07dc796 None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:04.159023 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636ca8f-ca97-409e-a2ff-e84fb07dc796 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:04.159295 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636ca8f-ca97-409e-a2ff-e84fb07dc796 None admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:04.159946 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636ca8f-ca97-409e-a2ff-e84fb07dc796 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:04.161487 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636ca8f-ca97-409e-a2ff-e84fb07dc796 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:04.214230 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 245/470] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:04.215068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659e099-1faf-41c1-9deb-f9a2894bc335 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:04.247826 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 226/471] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Sep 3 21:14:03 2022] POST /identity/v3/users => generated 248 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:14:04.296514 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:04.346312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659e099-1faf-41c1-9deb-f9a2894bc335 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:04.389676 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ba72a-8bfd-48df-a165-9924a9496ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:04.390628 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ba72a-8bfd-48df-a165-9924a9496ce0 None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:04.391112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ba72a-8bfd-48df-a165-9924a9496ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:04.391599 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ba72a-8bfd-48df-a165-9924a9496ce0 None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:04.392456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ba72a-8bfd-48df-a165-9924a9496ce0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:04.394265 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ba72a-8bfd-48df-a165-9924a9496ce0 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:04.505297 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 246/472] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Sep 3 21:14:04 2022] POST /identity/v3/users => generated 248 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:14:04.563159 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636ca8f-ca97-409e-a2ff-e84fb07dc796 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:04.683964 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636ca8f-ca97-409e-a2ff-e84fb07dc796 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:04.700955 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:04.729590 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9b76f-bd2d-47f7-bdfc-70074324a5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:04.730365 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9b76f-bd2d-47f7-bdfc-70074324a5a0 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:04.730594 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9b76f-bd2d-47f7-bdfc-70074324a5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:04.730757 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9b76f-bd2d-47f7-bdfc-70074324a5a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:04.742310 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9b76f-bd2d-47f7-bdfc-70074324a5a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:04.743891 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9b76f-bd2d-47f7-bdfc-70074324a5a0 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-e8e9b76f-bd2d-47f7-bdfc-70074324a5a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:04.763707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:04.764711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:04.765932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:04.765932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:04.765932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:04.765932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 227/473] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:04.773044 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ba72a-8bfd-48df-a165-9924a9496ce0 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:04.899426 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ba72a-8bfd-48df-a165-9924a9496ce0 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:04.923463 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:04.938863 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede9abe-a006-4182-8785-e70cc9ade9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:04.939766 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede9abe-a006-4182-8785-e70cc9ade9ea None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:04.940250 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede9abe-a006-4182-8785-e70cc9ade9ea None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:04.940733 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede9abe-a006-4182-8785-e70cc9ade9ea None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:04.941560 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede9abe-a006-4182-8785-e70cc9ade9ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:04.942040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede9abe-a006-4182-8785-e70cc9ade9ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:04.943682 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede9abe-a006-4182-8785-e70cc9ade9ea None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:04.958561 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 247/474] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:04.965594 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9b76f-bd2d-47f7-bdfc-70074324a5a0 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:05.078102 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9b76f-bd2d-47f7-bdfc-70074324a5a0 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:05.114465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921cf45-bc83-4402-a81b-92963569a5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:05.115083 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921cf45-bc83-4402-a81b-92963569a5d1 None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:05.115360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921cf45-bc83-4402-a81b-92963569a5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:05.115633 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921cf45-bc83-4402-a81b-92963569a5d1 None admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:05.116298 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921cf45-bc83-4402-a81b-92963569a5d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:05.117779 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921cf45-bc83-4402-a81b-92963569a5d1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:05.214951 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 228/475] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Sep 3 21:14:04 2022] POST /identity/v3/users => generated 249 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:14:06.335207 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7670e8-2d37-4829-bbf4-ea435a60c59a None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:06.336217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7670e8-2d37-4829-bbf4-ea435a60c59a None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:06.336758 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7670e8-2d37-4829-bbf4-ea435a60c59a None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:06.338814 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 248/476] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:06.345160 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed26c2e-946d-4170-872e-30d64d9e9b6a None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:06.346129 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed26c2e-946d-4170-872e-30d64d9e9b6a None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:06.346613 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed26c2e-946d-4170-872e-30d64d9e9b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:06.366791 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-8ed26c2e-946d-4170-872e-30d64d9e9b6a None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:06.368353 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-8ed26c2e-946d-4170-872e-30d64d9e9b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:06.388626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:06.448610 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 229/477] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:06.802442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7670e8-2d37-4829-bbf4-ea435a60c59a None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:06.826560 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad218747-f754-407d-aa57-03414f93c166 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:06.827201 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad218747-f754-407d-aa57-03414f93c166 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:06.827704 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad218747-f754-407d-aa57-03414f93c166 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:06.829650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 230/478] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:06.835696 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042c641-7589-4810-8bc2-0c2391785700 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:06.836442 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042c641-7589-4810-8bc2-0c2391785700 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:06.836964 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042c641-7589-4810-8bc2-0c2391785700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:06.861008 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-5042c641-7589-4810-8bc2-0c2391785700 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:06.863030 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-5042c641-7589-4810-8bc2-0c2391785700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:06.950053 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7670e8-2d37-4829-bbf4-ea435a60c59a None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:06.959766 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 231/479] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:14:06.993932 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a8cad-7094-4239-b32a-fc9a265540e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:06.995475 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8cad-7094-4239-b32a-fc9a265540e2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:06.996166 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8cad-7094-4239-b32a-fc9a265540e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:06.996676 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a8cad-7094-4239-b32a-fc9a265540e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:07.019515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a8cad-7094-4239-b32a-fc9a265540e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-9b7a8cad-7094-4239-b32a-fc9a265540e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:07.025382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:07.026845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:07.027793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:07.027793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:07.027793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:07.027793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:07.027793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:07.027793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:07.027793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:07.027793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:07.027793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:07.027793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:07.027793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:07.027793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:07.030094 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 249/480] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:07.036188 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a8cad-7094-4239-b32a-fc9a265540e2 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:07.036481 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e318b-b614-49d9-90d4-89ad2d440dc7 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:07.036796 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e318b-b614-49d9-90d4-89ad2d440dc7 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:07.037095 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e318b-b614-49d9-90d4-89ad2d440dc7 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:07.038584 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 232/481] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:07.044604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63e7d3-a3ed-4350-bdaa-233df2e6a4db None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:07.044965 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63e7d3-a3ed-4350-bdaa-233df2e6a4db None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:07.045213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63e7d3-a3ed-4350-bdaa-233df2e6a4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:07.065269 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-2b63e7d3-a3ed-4350-bdaa-233df2e6a4db None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:07.066397 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-2b63e7d3-a3ed-4350-bdaa-233df2e6a4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:07.106531 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:07.160692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 233/482] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:07.190703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a8cad-7094-4239-b32a-fc9a265540e2 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:07.241313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86107d-8081-425b-8423-57e20ca83277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:07.242349 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86107d-8081-425b-8423-57e20ca83277 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:07.242839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86107d-8081-425b-8423-57e20ca83277 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:07.243319 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86107d-8081-425b-8423-57e20ca83277 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:07.244216 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86107d-8081-425b-8423-57e20ca83277 None admin] RBAC: Adding query filter params (name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:07.245030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86107d-8081-425b-8423-57e20ca83277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:07.246742 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86107d-8081-425b-8423-57e20ca83277 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:07.257503 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 250/483] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:14:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:07.264586 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63e7d3-a3ed-4350-bdaa-233df2e6a4db None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:07.287057 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:07.339097 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86107d-8081-425b-8423-57e20ca83277 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:07.398792 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63e7d3-a3ed-4350-bdaa-233df2e6a4db None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:07.440467 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda3b97-b9c1-471a-92e0-72f48f45b3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:07.441233 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda3b97-b9c1-471a-92e0-72f48f45b3d3 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:07.441508 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda3b97-b9c1-471a-92e0-72f48f45b3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:07.441782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda3b97-b9c1-471a-92e0-72f48f45b3d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:07.454556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda3b97-b9c1-471a-92e0-72f48f45b3d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:07.456196 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbda3b97-b9c1-471a-92e0-72f48f45b3d3 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-bbda3b97-b9c1-471a-92e0-72f48f45b3d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:07.473859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:07.474917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:07.475766 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:07.475766 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:07.475766 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:07.475766 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 234/484] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:07.482597 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda3b97-b9c1-471a-92e0-72f48f45b3d3 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:07.485472 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86107d-8081-425b-8423-57e20ca83277 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:07.487623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:07.534963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5aa8b-369b-4c05-9f86-9a0f904e478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:07.535607 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5aa8b-369b-4c05-9f86-9a0f904e478f None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:07.535893 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5aa8b-369b-4c05-9f86-9a0f904e478f None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:07.536366 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5aa8b-369b-4c05-9f86-9a0f904e478f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:07.549330 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5aa8b-369b-4c05-9f86-9a0f904e478f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-57a5aa8b-369b-4c05-9f86-9a0f904e478f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:07.555562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:07.556649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:07.558189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:07.558189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:07.558189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:07.558189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:07.558189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:07.558189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:07.558189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:07.558189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:07.558189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:07.558189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:07.558189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:07.558189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:07.558189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 251/485] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:07.559634 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5aa8b-369b-4c05-9f86-9a0f904e478f None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:07.579763 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:07.629707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda3b97-b9c1-471a-92e0-72f48f45b3d3 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:07.673037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8493463-3125-438b-9919-ebeac4368a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:07.673649 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8493463-3125-438b-9919-ebeac4368a0d None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:07.673929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8493463-3125-438b-9919-ebeac4368a0d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:07.674201 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8493463-3125-438b-9919-ebeac4368a0d None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:07.674847 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8493463-3125-438b-9919-ebeac4368a0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:07.675155 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8493463-3125-438b-9919-ebeac4368a0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:07.676619 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8493463-3125-438b-9919-ebeac4368a0d None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:07.692499 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 235/486] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:07.692770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8493463-3125-438b-9919-ebeac4368a0d None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:07.703154 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5aa8b-369b-4c05-9f86-9a0f904e478f None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:07.758512 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ee78d-472f-47ca-982a-59246d180d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:07.759492 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ee78d-472f-47ca-982a-59246d180d49 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:07.759778 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ee78d-472f-47ca-982a-59246d180d49 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:07.760091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ee78d-472f-47ca-982a-59246d180d49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:07.772895 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ee78d-472f-47ca-982a-59246d180d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-f82ee78d-472f-47ca-982a-59246d180d49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:07.778740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:07.779842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:07.781183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:07.781183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:07.781183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:07.781183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:07.781183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:07.781183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:07.781183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:07.781183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:07.781183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:07.781183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:07.781183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:07.781183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:07.784895 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 252/487] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:07.786132 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289640d-fe64-43e8-86c2-6637d36481d5 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:07.786420 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289640d-fe64-43e8-86c2-6637d36481d5 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:07.786699 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289640d-fe64-43e8-86c2-6637d36481d5 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:07.788016 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 253/488] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:07.788754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289640d-fe64-43e8-86c2-6637d36481d5 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:07.816078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:07.822348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8493463-3125-438b-9919-ebeac4368a0d None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:07.851692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:07.868579 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd848b-3670-441d-b5c8-63652d47aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:07.869395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd848b-3670-441d-b5c8-63652d47aa94 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:07.870195 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd848b-3670-441d-b5c8-63652d47aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:07.870480 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd848b-3670-441d-b5c8-63652d47aa94 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:07.871160 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd848b-3670-441d-b5c8-63652d47aa94 None admin] RBAC: Adding query filter params (name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:07.871464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd848b-3670-441d-b5c8-63652d47aa94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:07.872895 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd848b-3670-441d-b5c8-63652d47aa94 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:07.881243 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 236/489] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:14:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:07.881971 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd848b-3670-441d-b5c8-63652d47aa94 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:07.909380 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289640d-fe64-43e8-86c2-6637d36481d5 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:07.947311 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6a303-2f3c-4647-8ae2-39ab4dbacdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:07.948007 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6a303-2f3c-4647-8ae2-39ab4dbacdae None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:07.948293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6a303-2f3c-4647-8ae2-39ab4dbacdae None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:07.948606 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6a303-2f3c-4647-8ae2-39ab4dbacdae None admin] PATH_INFO: `/v3/users/nova` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:07.957558 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6a303-2f3c-4647-8ae2-39ab4dbacdae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:07.959023 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6a303-2f3c-4647-8ae2-39ab4dbacdae None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-a6e6a303-2f3c-4647-8ae2-39ab4dbacdae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:07.972704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:07.973725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:07.974646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:07.974646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:07.974646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:07.974646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:07.974646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:07.974646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:07.974646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:07.974646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:07.974646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 21:14:07.974646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:07.974646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 254/490] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Sep 3 21:14:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:07.975204 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a18cca-b2e2-4824-9830-98032c76898d None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:07.975766 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a18cca-b2e2-4824-9830-98032c76898d None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:07.975766 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a18cca-b2e2-4824-9830-98032c76898d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:07.993184 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd848b-3670-441d-b5c8-63652d47aa94 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:07.994836 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-85a18cca-b2e2-4824-9830-98032c76898d None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:07.996981 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-85a18cca-b2e2-4824-9830-98032c76898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:08.032022 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298df1e-c9ed-4343-9973-bd7d11cbf1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:08.033130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298df1e-c9ed-4343-9973-bd7d11cbf1b0 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:08.033642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298df1e-c9ed-4343-9973-bd7d11cbf1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:08.034140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298df1e-c9ed-4343-9973-bd7d11cbf1b0 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:08.035343 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298df1e-c9ed-4343-9973-bd7d11cbf1b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:08.035932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298df1e-c9ed-4343-9973-bd7d11cbf1b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:08.038317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298df1e-c9ed-4343-9973-bd7d11cbf1b0 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:08.047781 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 237/491] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:14:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:08.048663 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298df1e-c9ed-4343-9973-bd7d11cbf1b0 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:08.072597 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 255/492] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:08.074063 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a18cca-b2e2-4824-9830-98032c76898d None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:08.096906 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:08.107457 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:08.167507 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298df1e-c9ed-4343-9973-bd7d11cbf1b0 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:08.194978 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a18cca-b2e2-4824-9830-98032c76898d None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:08.204401 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e91c9c-5a6a-4361-a0a4-63563dd1c864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:08.205067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e91c9c-5a6a-4361-a0a4-63563dd1c864 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:08.205346 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e91c9c-5a6a-4361-a0a4-63563dd1c864 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:08.205614 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e91c9c-5a6a-4361-a0a4-63563dd1c864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:08.217259 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e91c9c-5a6a-4361-a0a4-63563dd1c864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:08.218828 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e91c9c-5a6a-4361-a0a4-63563dd1c864 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:08.231960 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185891d-45aa-4298-913f-3123faa470e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:08.232585 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185891d-45aa-4298-913f-3123faa470e4 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:08.232865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185891d-45aa-4298-913f-3123faa470e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:08.233138 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185891d-45aa-4298-913f-3123faa470e4 None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:08.233859 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185891d-45aa-4298-913f-3123faa470e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-79e91c9c-5a6a-4361-a0a4-63563dd1c864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:08.234141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:08.235047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:08.235908 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:08.235908 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:08.235908 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:08.236071 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185891d-45aa-4298-913f-3123faa470e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:08.236071 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185891d-45aa-4298-913f-3123faa470e4 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:08.240176 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 238/493] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:08.241086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e91c9c-5a6a-4361-a0a4-63563dd1c864 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:08.280288 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 256/494] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Sep 3 21:14:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:08.280288 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185891d-45aa-4298-913f-3123faa470e4 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:08.354947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:08.359939 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:08.363706 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e91c9c-5a6a-4361-a0a4-63563dd1c864 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:08.388897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185891d-45aa-4298-913f-3123faa470e4 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:08.403883 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa70f3c-6882-4bc7-8cc4-1809d6195fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:08.404517 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa70f3c-6882-4bc7-8cc4-1809d6195fb8 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:08.404839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa70f3c-6882-4bc7-8cc4-1809d6195fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:08.405119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa70f3c-6882-4bc7-8cc4-1809d6195fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:08.416010 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa70f3c-6882-4bc7-8cc4-1809d6195fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:08.418482 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa70f3c-6882-4bc7-8cc4-1809d6195fb8 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:08.426907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f57a3-a48b-446b-99e6-aef401edf626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:08.427515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f57a3-a48b-446b-99e6-aef401edf626 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:08.427796 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f57a3-a48b-446b-99e6-aef401edf626 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:08.428064 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f57a3-a48b-446b-99e6-aef401edf626 None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:08.428751 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f57a3-a48b-446b-99e6-aef401edf626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:08.429039 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f57a3-a48b-446b-99e6-aef401edf626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:08.430420 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f57a3-a48b-446b-99e6-aef401edf626 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-baa70f3c-6882-4bc7-8cc4-1809d6195fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:08.433988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:08.434932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:08.435782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:08.435782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:08.435782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:08.435782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 239/495] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:08.436003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa70f3c-6882-4bc7-8cc4-1809d6195fb8 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:08.442708 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 257/496] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:08.443602 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f57a3-a48b-446b-99e6-aef401edf626 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:08.547849 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa70f3c-6882-4bc7-8cc4-1809d6195fb8 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:08.550595 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f57a3-a48b-446b-99e6-aef401edf626 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:08.579030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:08.582372 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fda3c3-438e-48b4-a7ea-a66f2394afe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:08.583002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fda3c3-438e-48b4-a7ea-a66f2394afe2 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:08.583285 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fda3c3-438e-48b4-a7ea-a66f2394afe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:08.583560 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fda3c3-438e-48b4-a7ea-a66f2394afe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:08.584789 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7ee35-d96a-4058-bdbe-9e3c6be804b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:08.592566 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7ee35-d96a-4058-bdbe-9e3c6be804b4 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:08.592566 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7ee35-d96a-4058-bdbe-9e3c6be804b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:08.592566 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7ee35-d96a-4058-bdbe-9e3c6be804b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:08.597252 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7ee35-d96a-4058-bdbe-9e3c6be804b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-04b7ee35-d96a-4058-bdbe-9e3c6be804b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:08.602034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:08.603105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:08.604024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:08.604024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:08.604024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:08.604024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:08.604024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:08.604024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:08.604024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:08.604024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:08.604024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:08.604024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:08.604024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:08.604024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:08.604024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 258/497] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:08.604024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7ee35-d96a-4058-bdbe-9e3c6be804b4 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:08.609741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:08.657767 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fda3c3-438e-48b4-a7ea-a66f2394afe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:08.659497 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fda3c3-438e-48b4-a7ea-a66f2394afe2 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:08.710965 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7ee35-d96a-4058-bdbe-9e3c6be804b4 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:08.746108 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffc746-3936-45a5-8973-2b4c12e631e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:08.746711 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffc746-3936-45a5-8973-2b4c12e631e0 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:08.746992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffc746-3936-45a5-8973-2b4c12e631e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:08.747270 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffc746-3936-45a5-8973-2b4c12e631e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:08.747914 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffc746-3936-45a5-8973-2b4c12e631e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:08.748224 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffc746-3936-45a5-8973-2b4c12e631e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:08.749689 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffc746-3936-45a5-8973-2b4c12e631e0 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:08.765050 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 259/498] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:08.765050 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffc746-3936-45a5-8973-2b4c12e631e0 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:08.771322 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 240/499] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:08.772460 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fda3c3-438e-48b4-a7ea-a66f2394afe2 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:08.828913 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:08.833258 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:08.880203 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffc746-3936-45a5-8973-2b4c12e631e0 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:08.880448 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fda3c3-438e-48b4-a7ea-a66f2394afe2 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:08.917800 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ebef2-c8fd-4b5c-8ddb-31a2ef816e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:08.918911 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef2ece-5660-4924-b3e3-7fea57315cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:08.919037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ebef2-c8fd-4b5c-8ddb-31a2ef816e2f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:08.919144 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2ece-5660-4924-b3e3-7fea57315cd3 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:08.919238 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ebef2-c8fd-4b5c-8ddb-31a2ef816e2f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:08.919326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2ece-5660-4924-b3e3-7fea57315cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:08.919413 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ebef2-c8fd-4b5c-8ddb-31a2ef816e2f None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:08.919489 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef2ece-5660-4924-b3e3-7fea57315cd3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:08.919767 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ebef2-c8fd-4b5c-8ddb-31a2ef816e2f None admin] RBAC: Adding query filter params (name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:08.920073 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ebef2-c8fd-4b5c-8ddb-31a2ef816e2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:08.921516 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ebef2-c8fd-4b5c-8ddb-31a2ef816e2f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:08.926981 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef2ece-5660-4924-b3e3-7fea57315cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:08.928442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef2ece-5660-4924-b3e3-7fea57315cd3 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:08.930311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 241/500] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:14:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:08.931189 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ebef2-c8fd-4b5c-8ddb-31a2ef816e2f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-e3ef2ece-5660-4924-b3e3-7fea57315cd3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:08.940868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:08.942084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:08.943030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:08.943030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:08.943030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:08.943030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:08.943030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:08.943030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:08.943030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:08.943030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:08.943030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 03 21:14:08.943030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:08.943030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 260/501] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:14:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:08.943030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef2ece-5660-4924-b3e3-7fea57315cd3 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:09.036963 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ebef2-c8fd-4b5c-8ddb-31a2ef816e2f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:09.052127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:09.055675 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef2ece-5660-4924-b3e3-7fea57315cd3 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:09.067053 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:09.072225 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a8cf9-eacc-45db-a3f2-40cafa4ae1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:09.072942 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a8cf9-eacc-45db-a3f2-40cafa4ae1a6 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:09.073223 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a8cf9-eacc-45db-a3f2-40cafa4ae1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:09.073498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a8cf9-eacc-45db-a3f2-40cafa4ae1a6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:09.081762 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a8cf9-eacc-45db-a3f2-40cafa4ae1a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:09.084427 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a8cf9-eacc-45db-a3f2-40cafa4ae1a6 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:09.092003 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d918b5-469b-4729-b1f4-2b864cade400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:09.094258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d918b5-469b-4729-b1f4-2b864cade400 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:09.094258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d918b5-469b-4729-b1f4-2b864cade400 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:09.094258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d918b5-469b-4729-b1f4-2b864cade400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-c05a8cf9-eacc-45db-a3f2-40cafa4ae1a6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:09.099044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:09.099916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:09.100857 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:09.100857 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:09.100857 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:09.100857 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:09.100857 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:09.100857 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:09.100857 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:09.100857 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:09.100857 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 21:14:09.100857 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:09.100857 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 242/502] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:14:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:09.101659 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a8cf9-eacc-45db-a3f2-40cafa4ae1a6 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:09.110064 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d918b5-469b-4729-b1f4-2b864cade400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:09.111939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d918b5-469b-4729-b1f4-2b864cade400 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-31d918b5-469b-4729-b1f4-2b864cade400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:09.127539 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:09.128780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:09.130314 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:09.130314 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:09.130314 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:09.130314 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 261/503] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:09.130314 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d918b5-469b-4729-b1f4-2b864cade400 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:09.224263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a8cf9-eacc-45db-a3f2-40cafa4ae1a6 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:09.249469 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d918b5-469b-4729-b1f4-2b864cade400 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:09.270086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a223-6fcb-4e2c-bb24-1f86686b3c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:09.270677 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a223-6fcb-4e2c-bb24-1f86686b3c9c None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:09.271026 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a223-6fcb-4e2c-bb24-1f86686b3c9c None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:09.271367 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291a223-6fcb-4e2c-bb24-1f86686b3c9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:09.287922 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291a223-6fcb-4e2c-bb24-1f86686b3c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:09.290476 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6240f-f827-4d5d-b4f2-ca7a5f41432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:09.290673 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291a223-6fcb-4e2c-bb24-1f86686b3c9c None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:09.291089 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6240f-f827-4d5d-b4f2-ca7a5f41432c None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:09.291370 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6240f-f827-4d5d-b4f2-ca7a5f41432c None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:09.292306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6240f-f827-4d5d-b4f2-ca7a5f41432c None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:09.293263 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6240f-f827-4d5d-b4f2-ca7a5f41432c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:09.293575 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6240f-f827-4d5d-b4f2-ca7a5f41432c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:09.295042 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6240f-f827-4d5d-b4f2-ca7a5f41432c None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:09.319436 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 262/504] 10.222.0.43 () {56 vars in 1137 bytes} [Sat Sep 3 21:14:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:09.319436 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6240f-f827-4d5d-b4f2-ca7a5f41432c None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-c291a223-6fcb-4e2c-bb24-1f86686b3c9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:09.319761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:09.320836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:09.321713 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:09.321713 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:09.321713 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:09.321713 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 243/505] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:09.321713 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a223-6fcb-4e2c-bb24-1f86686b3c9c None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:09.347049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:09.366318 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:09.439862 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6240f-f827-4d5d-b4f2-ca7a5f41432c None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:09.450584 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291a223-6fcb-4e2c-bb24-1f86686b3c9c None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:09.475897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669bf2f-fbea-4751-8cbb-19ac6311e7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:09.476520 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669bf2f-fbea-4751-8cbb-19ac6311e7d2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:09.476836 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669bf2f-fbea-4751-8cbb-19ac6311e7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:09.477115 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669bf2f-fbea-4751-8cbb-19ac6311e7d2 None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:09.477835 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669bf2f-fbea-4751-8cbb-19ac6311e7d2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:09.478147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669bf2f-fbea-4751-8cbb-19ac6311e7d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:09.479810 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669bf2f-fbea-4751-8cbb-19ac6311e7d2 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:09.485723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3c37c-ed94-4e69-9321-307a5f179023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:09.486321 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3c37c-ed94-4e69-9321-307a5f179023 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:09.486598 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3c37c-ed94-4e69-9321-307a5f179023 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:09.486867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3c37c-ed94-4e69-9321-307a5f179023 None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:09.487499 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3c37c-ed94-4e69-9321-307a5f179023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:09.487801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3c37c-ed94-4e69-9321-307a5f179023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:09.489187 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3c37c-ed94-4e69-9321-307a5f179023 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:09.497983 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 263/506] 10.222.0.43 () {56 vars in 1137 bytes} [Sat Sep 3 21:14:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:09.498904 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669bf2f-fbea-4751-8cbb-19ac6311e7d2 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:09.506250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 244/507] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:09.507101 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3c37c-ed94-4e69-9321-307a5f179023 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:09.590461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:09.602736 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:09.614820 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669bf2f-fbea-4751-8cbb-19ac6311e7d2 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:09.620031 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3c37c-ed94-4e69-9321-307a5f179023 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:09.655012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b3078-b3af-400e-be2f-fd7f4b304a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:09.655709 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b3078-b3af-400e-be2f-fd7f4b304a67 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:09.655992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b3078-b3af-400e-be2f-fd7f4b304a67 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:09.656294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b3078-b3af-400e-be2f-fd7f4b304a67 None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:09.657106 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b3078-b3af-400e-be2f-fd7f4b304a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:09.657421 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b3078-b3af-400e-be2f-fd7f4b304a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:09.658856 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b3078-b3af-400e-be2f-fd7f4b304a67 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:09.661154 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b6ba5-4786-4f57-9d36-b254f08b62b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:09.661779 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b6ba5-4786-4f57-9d36-b254f08b62b5 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:09.662059 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b6ba5-4786-4f57-9d36-b254f08b62b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:09.662329 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b6ba5-4786-4f57-9d36-b254f08b62b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:09.672362 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 264/508] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:09.677726 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b3078-b3af-400e-be2f-fd7f4b304a67 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:09.741961 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b6ba5-4786-4f57-9d36-b254f08b62b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:09.743478 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b6ba5-4786-4f57-9d36-b254f08b62b5 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:09.788910 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b3078-b3af-400e-be2f-fd7f4b304a67 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:09.826773 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a472760-915a-438c-aeab-2c69b4d0df35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:09.827376 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a472760-915a-438c-aeab-2c69b4d0df35 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:09.827656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a472760-915a-438c-aeab-2c69b4d0df35 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:09.827928 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a472760-915a-438c-aeab-2c69b4d0df35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:09.837031 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:09.856973 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:09.860223 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 245/509] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:09.861114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b6ba5-4786-4f57-9d36-b254f08b62b5 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:09.900081 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a472760-915a-438c-aeab-2c69b4d0df35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:09.902189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a472760-915a-438c-aeab-2c69b4d0df35 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:09.964886 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b6ba5-4786-4f57-9d36-b254f08b62b5 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:10.000900 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c2f44-0ef7-470b-a9bf-e608aff3d0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:10.003727 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c2f44-0ef7-470b-a9bf-e608aff3d0ab None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:10.003727 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c2f44-0ef7-470b-a9bf-e608aff3d0ab None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:10.003727 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c2f44-0ef7-470b-a9bf-e608aff3d0ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:10.003951 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 265/510] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:10.004699 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a472760-915a-438c-aeab-2c69b4d0df35 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:10.010048 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c2f44-0ef7-470b-a9bf-e608aff3d0ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:10.011637 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c2f44-0ef7-470b-a9bf-e608aff3d0ab None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-c59c2f44-0ef7-470b-a9bf-e608aff3d0ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:10.024628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:10.025692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:10.034838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:10.034838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:10.034838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:10.034838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:10.034838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:10.034838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:10.034838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:10.034838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:10.034838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 246/511] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:10.034838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c2f44-0ef7-470b-a9bf-e608aff3d0ab None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:10.053567 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:10.077817 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:10.125914 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a472760-915a-438c-aeab-2c69b4d0df35 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:10.141583 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c2f44-0ef7-470b-a9bf-e608aff3d0ab None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:10.162656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21847118-397d-408f-90b4-bd7d4699ac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:10.163292 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21847118-397d-408f-90b4-bd7d4699ac23 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:10.163570 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21847118-397d-408f-90b4-bd7d4699ac23 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:10.163840 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21847118-397d-408f-90b4-bd7d4699ac23 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:10.172273 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21847118-397d-408f-90b4-bd7d4699ac23 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:10.176088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21847118-397d-408f-90b4-bd7d4699ac23 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:10.178329 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e431c5-b28c-4321-938a-c032ebdc0c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:10.178958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e431c5-b28c-4321-938a-c032ebdc0c33 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:10.179239 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e431c5-b28c-4321-938a-c032ebdc0c33 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:10.179511 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e431c5-b28c-4321-938a-c032ebdc0c33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-21847118-397d-408f-90b4-bd7d4699ac23 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:10.186040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:10.187142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:10.188142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:10.188142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:10.188142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:10.188142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:10.188142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:10.188142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:10.188142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:10.188142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:10.188142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 21:14:10.188142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:10.188142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 266/512] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:10.188142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21847118-397d-408f-90b4-bd7d4699ac23 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:10.193653 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e431c5-b28c-4321-938a-c032ebdc0c33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:10.195197 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e431c5-b28c-4321-938a-c032ebdc0c33 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-76e431c5-b28c-4321-938a-c032ebdc0c33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:10.211510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:10.212676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:10.213523 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:10.213523 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:10.213523 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:10.213523 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 247/513] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:10.213523 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e431c5-b28c-4321-938a-c032ebdc0c33 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:10.293382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:10.297122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21847118-397d-408f-90b4-bd7d4699ac23 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:10.318899 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:10.322745 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e431c5-b28c-4321-938a-c032ebdc0c33 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:10.331627 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f35442-d0e0-4f90-8ff8-b682f95d3212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:10.332271 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f35442-d0e0-4f90-8ff8-b682f95d3212 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:10.332906 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f35442-d0e0-4f90-8ff8-b682f95d3212 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:10.333286 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f35442-d0e0-4f90-8ff8-b682f95d3212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:10.345835 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f35442-d0e0-4f90-8ff8-b682f95d3212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:10.347293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f35442-d0e0-4f90-8ff8-b682f95d3212 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:10.358352 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b11086-9071-4336-a12d-7da0c8145d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:10.358947 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b11086-9071-4336-a12d-7da0c8145d54 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:10.359226 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b11086-9071-4336-a12d-7da0c8145d54 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:10.359494 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b11086-9071-4336-a12d-7da0c8145d54 None admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:10.360179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b11086-9071-4336-a12d-7da0c8145d54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:10.360493 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b11086-9071-4336-a12d-7da0c8145d54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-95f35442-d0e0-4f90-8ff8-b682f95d3212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:10.362414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:10.363486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:10.369100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:10.369100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:10.369100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:10.369278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b11086-9071-4336-a12d-7da0c8145d54 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:10.369350 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 267/514] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:10.369350 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f35442-d0e0-4f90-8ff8-b682f95d3212 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:10.388049 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 248/515] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:10.389023 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b11086-9071-4336-a12d-7da0c8145d54 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:10.468124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f35442-d0e0-4f90-8ff8-b682f95d3212 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:10.497462 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b11086-9071-4336-a12d-7da0c8145d54 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:10.502894 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac8f5f-a1f2-47a5-b392-f600e1b561d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:10.503493 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac8f5f-a1f2-47a5-b392-f600e1b561d0 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:10.503774 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac8f5f-a1f2-47a5-b392-f600e1b561d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:10.504043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac8f5f-a1f2-47a5-b392-f600e1b561d0 None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:10.504802 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac8f5f-a1f2-47a5-b392-f600e1b561d0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:10.505103 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac8f5f-a1f2-47a5-b392-f600e1b561d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:10.506536 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac8f5f-a1f2-47a5-b392-f600e1b561d0 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:10.524396 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 268/516] 10.222.0.43 () {56 vars in 1139 bytes} [Sat Sep 3 21:14:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:10.525365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac8f5f-a1f2-47a5-b392-f600e1b561d0 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:10.532651 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cce4f7-5390-47ab-b1b2-35203d9a50be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:10.533266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cce4f7-5390-47ab-b1b2-35203d9a50be None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:10.533543 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cce4f7-5390-47ab-b1b2-35203d9a50be None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:10.533809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cce4f7-5390-47ab-b1b2-35203d9a50be None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:10.534447 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cce4f7-5390-47ab-b1b2-35203d9a50be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:10.534746 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cce4f7-5390-47ab-b1b2-35203d9a50be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:10.536170 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cce4f7-5390-47ab-b1b2-35203d9a50be None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:10.536300 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:10.548327 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 249/517] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:10.549201 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cce4f7-5390-47ab-b1b2-35203d9a50be None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:10.573496 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:10.631739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac8f5f-a1f2-47a5-b392-f600e1b561d0 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:10.658003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cce4f7-5390-47ab-b1b2-35203d9a50be None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:10.667948 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b75ca-1c41-4d56-87dc-8456901cc871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:10.668578 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b75ca-1c41-4d56-87dc-8456901cc871 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:10.668861 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b75ca-1c41-4d56-87dc-8456901cc871 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:10.669162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b75ca-1c41-4d56-87dc-8456901cc871 None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:10.669762 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b75ca-1c41-4d56-87dc-8456901cc871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:10.670062 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b75ca-1c41-4d56-87dc-8456901cc871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:10.671432 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b75ca-1c41-4d56-87dc-8456901cc871 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:10.683359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 269/518] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:10.684186 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b75ca-1c41-4d56-87dc-8456901cc871 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:10.693033 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ed8a-922f-420c-a32a-484d6090a49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:10.693627 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ed8a-922f-420c-a32a-484d6090a49d None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:10.693907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ed8a-922f-420c-a32a-484d6090a49d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:10.694180 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7940ed8a-922f-420c-a32a-484d6090a49d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:10.694931 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940ed8a-922f-420c-a32a-484d6090a49d None admin] RBAC: Adding query filter params (role.id=a591fae52df7454f9d4067c495390a2e, scope.project.id=3bae29e3189d480c9200f03128f0c607, user.id=7d95ba5e28764ed49d1142fecb16adab) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:10.695242 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940ed8a-922f-420c-a32a-484d6090a49d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:10.696773 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7940ed8a-922f-420c-a32a-484d6090a49d None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:10.703053 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 250/519] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:14:10 2022] GET /identity/v3/role_assignments?user.id=7d95ba5e28764ed49d1142fecb16adab&scope.project.id=3bae29e3189d480c9200f03128f0c607&role.id=a591fae52df7454f9d4067c495390a2e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:10.703706 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ed8a-922f-420c-a32a-484d6090a49d None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:10.770811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:10.812231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b75ca-1c41-4d56-87dc-8456901cc871 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:10.821276 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:10.843787 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7940ed8a-922f-420c-a32a-484d6090a49d None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:10.853363 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e96a8-6e2a-49b2-b664-82147c63520c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:10.853973 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e96a8-6e2a-49b2-b664-82147c63520c None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:10.854384 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e96a8-6e2a-49b2-b664-82147c63520c None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:10.855153 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e96a8-6e2a-49b2-b664-82147c63520c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:10.883852 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6a6aa-e34d-4628-9c68-a7a9e7e7553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:10.884495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6a6aa-e34d-4628-9c68-a7a9e7e7553d None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:10.884813 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6a6aa-e34d-4628-9c68-a7a9e7e7553d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:10.885081 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6a6aa-e34d-4628-9c68-a7a9e7e7553d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:10.894731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6a6aa-e34d-4628-9c68-a7a9e7e7553d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:10.896208 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6a6aa-e34d-4628-9c68-a7a9e7e7553d None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-f0c6a6aa-e34d-4628-9c68-a7a9e7e7553d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:10.910065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:10.910933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:10.911831 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:10.911831 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:10.911831 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:10.911831 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:10.911831 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:10.911831 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:10.911831 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:10.911831 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:10.911831 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 251/520] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:10.912311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6a6aa-e34d-4628-9c68-a7a9e7e7553d None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:10.941960 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e96a8-6e2a-49b2-b664-82147c63520c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:10.943494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e96a8-6e2a-49b2-b664-82147c63520c None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:11.018000 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:11.031797 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6a6aa-e34d-4628-9c68-a7a9e7e7553d None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:11.065526 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 270/521] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:14:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:11.065526 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e96a8-6e2a-49b2-b664-82147c63520c None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:11.066954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457d312-a2c2-4863-96e0-d3b7558ebbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:11.067586 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d312-a2c2-4863-96e0-d3b7558ebbbe None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:11.067863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d312-a2c2-4863-96e0-d3b7558ebbbe None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:11.068142 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457d312-a2c2-4863-96e0-d3b7558ebbbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:11.075839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457d312-a2c2-4863-96e0-d3b7558ebbbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:11.077354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0457d312-a2c2-4863-96e0-d3b7558ebbbe None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-0457d312-a2c2-4863-96e0-d3b7558ebbbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:11.089914 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:11.091001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:11.091894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:11.091894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:11.091894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:11.091894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:11.091894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:11.091894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:11.091894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:11.091894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:11.091894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 252/522] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:11.092515 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457d312-a2c2-4863-96e0-d3b7558ebbbe None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:11.098519 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:11.184509 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e96a8-6e2a-49b2-b664-82147c63520c None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:11.208815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457d312-a2c2-4863-96e0-d3b7558ebbbe None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:11.223707 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b72a4-f543-43f4-a990-793cd9e6ecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:11.224307 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b72a4-f543-43f4-a990-793cd9e6ecd2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:11.224609 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b72a4-f543-43f4-a990-793cd9e6ecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:11.224879 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b72a4-f543-43f4-a990-793cd9e6ecd2 None admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:11.225569 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b72a4-f543-43f4-a990-793cd9e6ecd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:11.225872 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b72a4-f543-43f4-a990-793cd9e6ecd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:11.227294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b72a4-f543-43f4-a990-793cd9e6ecd2 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:11.247362 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 271/523] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:11.248242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b72a4-f543-43f4-a990-793cd9e6ecd2 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:11.252997 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd11f8-7a4e-464c-9c86-1a35994d5409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:11.253646 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd11f8-7a4e-464c-9c86-1a35994d5409 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:11.253992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd11f8-7a4e-464c-9c86-1a35994d5409 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:11.254204 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd11f8-7a4e-464c-9c86-1a35994d5409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:11.266625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd11f8-7a4e-464c-9c86-1a35994d5409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:11.268121 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd11f8-7a4e-464c-9c86-1a35994d5409 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:11.281538 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-08bd11f8-7a4e-464c-9c86-1a35994d5409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:11.286580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:11.287524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:11.288379 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:11.288379 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:11.288379 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:11.288379 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 253/524] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:11.289543 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd11f8-7a4e-464c-9c86-1a35994d5409 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:11.352353 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:11.372181 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b72a4-f543-43f4-a990-793cd9e6ecd2 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:11.411156 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd11f8-7a4e-464c-9c86-1a35994d5409 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:11.413872 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d30031-97c6-4e6e-a649-83325fa91ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:11.414605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30031-97c6-4e6e-a649-83325fa91ffe None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:11.414886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30031-97c6-4e6e-a649-83325fa91ffe None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:11.415156 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d30031-97c6-4e6e-a649-83325fa91ffe None admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:11.415843 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d30031-97c6-4e6e-a649-83325fa91ffe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:11.416146 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d30031-97c6-4e6e-a649-83325fa91ffe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:11.418681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d30031-97c6-4e6e-a649-83325fa91ffe None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:11.430723 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 272/525] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:11.431571 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d30031-97c6-4e6e-a649-83325fa91ffe None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:11.457428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652289d0-a5a6-4baf-9fe5-c9cb837cd396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:11.457975 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652289d0-a5a6-4baf-9fe5-c9cb837cd396 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:11.458254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652289d0-a5a6-4baf-9fe5-c9cb837cd396 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:11.458525 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652289d0-a5a6-4baf-9fe5-c9cb837cd396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:11.459255 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652289d0-a5a6-4baf-9fe5-c9cb837cd396 None admin] RBAC: Adding query filter params (role.id=a591fae52df7454f9d4067c495390a2e, scope.project.id=3bae29e3189d480c9200f03128f0c607, user.id=c05e9121d1bc48d497410de13a07b198) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:11.459612 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652289d0-a5a6-4baf-9fe5-c9cb837cd396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:11.461115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652289d0-a5a6-4baf-9fe5-c9cb837cd396 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:11.467879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 254/526] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:14:11 2022] GET /identity/v3/role_assignments?user.id=c05e9121d1bc48d497410de13a07b198&scope.project.id=3bae29e3189d480c9200f03128f0c607&role.id=a591fae52df7454f9d4067c495390a2e => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:11.468736 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652289d0-a5a6-4baf-9fe5-c9cb837cd396 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:11.564850 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:11.583328 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d30031-97c6-4e6e-a649-83325fa91ffe None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:11.625835 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652289d0-a5a6-4baf-9fe5-c9cb837cd396 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:11.628274 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b995be9-0ad6-417d-a9d6-4e765154fd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:11.629261 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995be9-0ad6-417d-a9d6-4e765154fd35 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:11.629765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995be9-0ad6-417d-a9d6-4e765154fd35 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:11.630245 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b995be9-0ad6-417d-a9d6-4e765154fd35 None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:11.631150 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b995be9-0ad6-417d-a9d6-4e765154fd35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:11.631654 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b995be9-0ad6-417d-a9d6-4e765154fd35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:11.633390 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b995be9-0ad6-417d-a9d6-4e765154fd35 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:11.649064 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 273/527] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:11.650558 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:11.660578 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b995be9-0ad6-417d-a9d6-4e765154fd35 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:11.678821 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13f71-66ac-4380-b522-0315c686c129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:11.679262 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13f71-66ac-4380-b522-0315c686c129 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:11.679544 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13f71-66ac-4380-b522-0315c686c129 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:11.680046 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13f71-66ac-4380-b522-0315c686c129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:11.681360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea13f71-66ac-4380-b522-0315c686c129 None admin] RBAC: Adding query filter params (role.id=a591fae52df7454f9d4067c495390a2e, scope.project.id=3bae29e3189d480c9200f03128f0c607, user.id=90cd1e165f3c4eba95dc93a25011b695) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:11.681678 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea13f71-66ac-4380-b522-0315c686c129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:11.683908 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea13f71-66ac-4380-b522-0315c686c129 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:11.693122 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 255/528] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:14:11 2022] GET /identity/v3/role_assignments?user.id=90cd1e165f3c4eba95dc93a25011b695&scope.project.id=3bae29e3189d480c9200f03128f0c607&role.id=a591fae52df7454f9d4067c495390a2e => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:11.792911 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b995be9-0ad6-417d-a9d6-4e765154fd35 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:11.834314 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ccc2b-c01e-4175-be48-840f3c2e18ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:11.835005 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ccc2b-c01e-4175-be48-840f3c2e18ac None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:11.835286 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ccc2b-c01e-4175-be48-840f3c2e18ac None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:11.835609 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ccc2b-c01e-4175-be48-840f3c2e18ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:11.844214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ccc2b-c01e-4175-be48-840f3c2e18ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:11.845767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ccc2b-c01e-4175-be48-840f3c2e18ac None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-061ccc2b-c01e-4175-be48-840f3c2e18ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:11.860388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:11.861343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:11.862202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:11.862202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:11.862202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:11.862202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:11.862202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:11.862202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:11.862202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:11.862202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:11.862202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 274/529] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:11.869771 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13f71-66ac-4380-b522-0315c686c129 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:11.991822 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13f71-66ac-4380-b522-0315c686c129 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:12.040173 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289fbd3-58bc-4c0f-9600-6a8e10bd98a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:12.041191 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289fbd3-58bc-4c0f-9600-6a8e10bd98a9 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:12.042207 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289fbd3-58bc-4c0f-9600-6a8e10bd98a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:12.042965 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289fbd3-58bc-4c0f-9600-6a8e10bd98a9 None admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:12.043906 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289fbd3-58bc-4c0f-9600-6a8e10bd98a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:12.044418 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289fbd3-58bc-4c0f-9600-6a8e10bd98a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:12.046146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289fbd3-58bc-4c0f-9600-6a8e10bd98a9 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:12.060883 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 256/530] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:12.066525 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ccc2b-c01e-4175-be48-840f3c2e18ac None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:12.081944 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:12.185721 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ccc2b-c01e-4175-be48-840f3c2e18ac None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:12.223498 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cebe53-3b20-4a22-9dab-7ca0ec743423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:12.224469 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cebe53-3b20-4a22-9dab-7ca0ec743423 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:12.225005 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cebe53-3b20-4a22-9dab-7ca0ec743423 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:12.225482 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cebe53-3b20-4a22-9dab-7ca0ec743423 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:12.226416 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cebe53-3b20-4a22-9dab-7ca0ec743423 None admin] RBAC: Adding query filter params (role.id=a591fae52df7454f9d4067c495390a2e, scope.project.id=3bae29e3189d480c9200f03128f0c607, user.id=a969a77183c34a7e9eff28636b1170c3) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:12.226957 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cebe53-3b20-4a22-9dab-7ca0ec743423 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:12.228737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cebe53-3b20-4a22-9dab-7ca0ec743423 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:12.236055 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 275/531] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:14:12 2022] GET /identity/v3/role_assignments?user.id=a969a77183c34a7e9eff28636b1170c3&scope.project.id=3bae29e3189d480c9200f03128f0c607&role.id=a591fae52df7454f9d4067c495390a2e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:13.070599 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3c189-b619-4bea-bd35-a45cf5fd87f2 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:13.071179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3c189-b619-4bea-bd35-a45cf5fd87f2 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:13.071179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3c189-b619-4bea-bd35-a45cf5fd87f2 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:13.072697 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 257/532] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:13.080497 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14465329-992c-4350-8c9e-2d7f6000b3ac None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:13.080497 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14465329-992c-4350-8c9e-2d7f6000b3ac None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:13.081234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14465329-992c-4350-8c9e-2d7f6000b3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:13.105756 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-14465329-992c-4350-8c9e-2d7f6000b3ac None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:13.107313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-14465329-992c-4350-8c9e-2d7f6000b3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:13.192636 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 276/533] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:13.522560 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3c189-b619-4bea-bd35-a45cf5fd87f2 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:13.572818 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:13.637985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3c189-b619-4bea-bd35-a45cf5fd87f2 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:13.683492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb692751-7d17-4946-8032-cee48b08f78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:13.684170 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb692751-7d17-4946-8032-cee48b08f78c None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:13.684506 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb692751-7d17-4946-8032-cee48b08f78c None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:13.684806 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb692751-7d17-4946-8032-cee48b08f78c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:13.699082 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb692751-7d17-4946-8032-cee48b08f78c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-eb692751-7d17-4946-8032-cee48b08f78c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:13.704304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:13.705668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:13.706572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:13.706572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:13.706572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:13.706572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:13.706572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:13.706572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:13.706572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:13.706572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:13.706572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:13.706572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:13.706572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:13.706572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:13.706572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 258/534] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:13.712275 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14465329-992c-4350-8c9e-2d7f6000b3ac None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:13.714060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:13.824293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14465329-992c-4350-8c9e-2d7f6000b3ac None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:13.853845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12a7fd-0203-468d-8657-2d61ed95d611 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:13.854193 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12a7fd-0203-468d-8657-2d61ed95d611 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:13.854992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12a7fd-0203-468d-8657-2d61ed95d611 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:13.856695 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 259/535] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:13.861982 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b576a39-8c23-42b3-bce8-8ded428e7028 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:13.862268 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b576a39-8c23-42b3-bce8-8ded428e7028 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:13.862543 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b576a39-8c23-42b3-bce8-8ded428e7028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:13.863358 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e6d77-7bc7-4ad5-b070-e66d87bcfb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:13.863976 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e6d77-7bc7-4ad5-b070-e66d87bcfb62 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:13.864263 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e6d77-7bc7-4ad5-b070-e66d87bcfb62 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:13.864565 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e6d77-7bc7-4ad5-b070-e66d87bcfb62 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:13.865253 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e6d77-7bc7-4ad5-b070-e66d87bcfb62 None admin] RBAC: Adding query filter params (name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:13.865566 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e6d77-7bc7-4ad5-b070-e66d87bcfb62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:13.867073 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e6d77-7bc7-4ad5-b070-e66d87bcfb62 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:13.876728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 277/536] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:14:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:13.882189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e6d77-7bc7-4ad5-b070-e66d87bcfb62 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:13.883235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-5b576a39-8c23-42b3-bce8-8ded428e7028 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:13.884765 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-5b576a39-8c23-42b3-bce8-8ded428e7028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:13.976586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:13.976823 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 260/537] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:14:14.024923 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e6d77-7bc7-4ad5-b070-e66d87bcfb62 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:14.065546 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4288357-faf1-4b37-ad90-f1c63ce44b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:14.066258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4288357-faf1-4b37-ad90-f1c63ce44b56 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:14.066598 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4288357-faf1-4b37-ad90-f1c63ce44b56 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:14.066877 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4288357-faf1-4b37-ad90-f1c63ce44b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:14.088641 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4288357-faf1-4b37-ad90-f1c63ce44b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:14.088641 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4288357-faf1-4b37-ad90-f1c63ce44b56 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-b4288357-faf1-4b37-ad90-f1c63ce44b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:14.099962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:14.100992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:14.101837 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:14.101837 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:14.101837 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:14.101837 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 278/538] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:14.107549 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b576a39-8c23-42b3-bce8-8ded428e7028 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:14.160929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:14.194585 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a22f5-a817-43bd-95eb-f7dc52c77b1b None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:14.195010 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a22f5-a817-43bd-95eb-f7dc52c77b1b None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:14.195364 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a22f5-a817-43bd-95eb-f7dc52c77b1b None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:14.197119 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 279/539] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:14:14.204858 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e1458-68d1-4d07-8fe8-55f7aded426a None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:14.205195 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e1458-68d1-4d07-8fe8-55f7aded426a None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:14.205468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e1458-68d1-4d07-8fe8-55f7aded426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:14.228094 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-648e1458-68d1-4d07-8fe8-55f7aded426a None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:14.230436 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-648e1458-68d1-4d07-8fe8-55f7aded426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:14.238539 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b576a39-8c23-42b3-bce8-8ded428e7028 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:14.288740 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20fd51-c75b-4d1e-9357-967ed353edcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:14.289658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20fd51-c75b-4d1e-9357-967ed353edcb None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:14.289939 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20fd51-c75b-4d1e-9357-967ed353edcb None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:14.290214 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20fd51-c75b-4d1e-9357-967ed353edcb None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:14.291211 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20fd51-c75b-4d1e-9357-967ed353edcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:14.291527 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20fd51-c75b-4d1e-9357-967ed353edcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:14.294096 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20fd51-c75b-4d1e-9357-967ed353edcb None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:14.321404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 261/540] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:14.323567 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20fd51-c75b-4d1e-9357-967ed353edcb None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:14.339630 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 280/541] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:14.369603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e1458-68d1-4d07-8fe8-55f7aded426a None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:14.423454 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:14.438219 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:14.447329 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20fd51-c75b-4d1e-9357-967ed353edcb None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:14.486682 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e1458-68d1-4d07-8fe8-55f7aded426a None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:14.487233 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df29617-6335-41d9-8c85-68204311b49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:14.487887 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29617-6335-41d9-8c85-68204311b49b None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:14.488168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29617-6335-41d9-8c85-68204311b49b None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:14.488443 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29617-6335-41d9-8c85-68204311b49b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:14.499186 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df29617-6335-41d9-8c85-68204311b49b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:14.500782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df29617-6335-41d9-8c85-68204311b49b None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-6df29617-6335-41d9-8c85-68204311b49b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:14.515114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:14.516143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:14.517061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:14.517061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:14.517061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:14.517061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:14.517061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:14.517061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:14.517061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:14.517061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:14.517061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 21:14:14.517061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:14.521331 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 262/542] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Sep 3 21:14:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:14:14.522703 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df29617-6335-41d9-8c85-68204311b49b None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:14.538604 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b28cb5-1e96-4d25-a1d5-401878b2814c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:14.539612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28cb5-1e96-4d25-a1d5-401878b2814c None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:14.540218 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28cb5-1e96-4d25-a1d5-401878b2814c None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:14.540739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28cb5-1e96-4d25-a1d5-401878b2814c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:14.554237 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b28cb5-1e96-4d25-a1d5-401878b2814c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-70b28cb5-1e96-4d25-a1d5-401878b2814c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:14.560656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:14.561586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:14.562365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:14.562365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:14.562365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:14.562365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:14.562365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:14.562365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:14.562365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:14.562365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:14.562365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:14.562365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:14.562365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:14.562365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:14.569878 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 281/543] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:14:14.571673 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b28cb5-1e96-4d25-a1d5-401878b2814c None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:14.643010 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df29617-6335-41d9-8c85-68204311b49b None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:14.684205 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e00aea-7d5b-41e8-8a5a-d45cf0a1fcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:14.684852 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00aea-7d5b-41e8-8a5a-d45cf0a1fcbf None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:14.685189 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00aea-7d5b-41e8-8a5a-d45cf0a1fcbf None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:14.685468 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00aea-7d5b-41e8-8a5a-d45cf0a1fcbf None admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:14.686476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e00aea-7d5b-41e8-8a5a-d45cf0a1fcbf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:14.686476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e00aea-7d5b-41e8-8a5a-d45cf0a1fcbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:14.688079 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e00aea-7d5b-41e8-8a5a-d45cf0a1fcbf None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:14.691253 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b28cb5-1e96-4d25-a1d5-401878b2814c None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:14.702950 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:14.729246 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 263/544] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Sep 3 21:14:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:14.731255 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35688a2a-6fc4-477f-9f38-ef816a83ad5c None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:14.731544 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35688a2a-6fc4-477f-9f38-ef816a83ad5c None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:14.731817 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35688a2a-6fc4-477f-9f38-ef816a83ad5c None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:14.734405 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 264/545] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:14.734567 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e653e54-23c2-4b27-863f-22b70ac4cf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:14.734674 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35688a2a-6fc4-477f-9f38-ef816a83ad5c None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:14.734749 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e653e54-23c2-4b27-863f-22b70ac4cf65 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:14.734829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e653e54-23c2-4b27-863f-22b70ac4cf65 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:14.735104 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e653e54-23c2-4b27-863f-22b70ac4cf65 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:14.735727 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e653e54-23c2-4b27-863f-22b70ac4cf65 None admin] RBAC: Adding query filter params (name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:14.736891 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e653e54-23c2-4b27-863f-22b70ac4cf65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:14.737854 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e653e54-23c2-4b27-863f-22b70ac4cf65 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:14.747281 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 282/546] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:14:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:14.748136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e653e54-23c2-4b27-863f-22b70ac4cf65 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:14.749597 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:14.868611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e653e54-23c2-4b27-863f-22b70ac4cf65 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:14.907834 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee335cac-5232-4349-b055-4106eb27b964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:14.908383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee335cac-5232-4349-b055-4106eb27b964 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:14.908821 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee335cac-5232-4349-b055-4106eb27b964 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:14.909091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee335cac-5232-4349-b055-4106eb27b964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:14.909316 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35688a2a-6fc4-477f-9f38-ef816a83ad5c None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:14.921131 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee335cac-5232-4349-b055-4106eb27b964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:14.922618 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee335cac-5232-4349-b055-4106eb27b964 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-ee335cac-5232-4349-b055-4106eb27b964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:14.938737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:14.939717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:14.940633 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:14.940633 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:14.940633 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:14.940633 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 283/547] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:14.941443 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b17b9-bf8e-49ea-a062-7c531e2911e5 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:14.941724 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b17b9-bf8e-49ea-a062-7c531e2911e5 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:14.941990 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b17b9-bf8e-49ea-a062-7c531e2911e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:14.952920 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d386a-37e8-43a5-8304-7fde7ffa131a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:14.953566 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d386a-37e8-43a5-8304-7fde7ffa131a None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:14.953840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d386a-37e8-43a5-8304-7fde7ffa131a None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:14.954108 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d386a-37e8-43a5-8304-7fde7ffa131a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:14.960665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-ab0b17b9-bf8e-49ea-a062-7c531e2911e5 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:14.961760 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-ab0b17b9-bf8e-49ea-a062-7c531e2911e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:14.964989 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d386a-37e8-43a5-8304-7fde7ffa131a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-9d2d386a-37e8-43a5-8304-7fde7ffa131a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:14.969843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:14.970925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:14.971808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:14.971808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:14.971808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:14.971808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:14.971808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:14.971808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:14.971808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:14.971808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:14.971808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:14.971808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:14.971808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:14.971808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:14.971808 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 265/548] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:14.972467 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d386a-37e8-43a5-8304-7fde7ffa131a None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:14.984596 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:15.049717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 284/549] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:15.050839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b17b9-bf8e-49ea-a062-7c531e2911e5 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:15.070336 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:15.121442 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d386a-37e8-43a5-8304-7fde7ffa131a None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:15.162157 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc37aff-cc63-43d8-bb31-dfff4fca198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:15.162697 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37aff-cc63-43d8-bb31-dfff4fca198b None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:15.162973 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37aff-cc63-43d8-bb31-dfff4fca198b None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:15.163246 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc37aff-cc63-43d8-bb31-dfff4fca198b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:15.180871 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc37aff-cc63-43d8-bb31-dfff4fca198b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:15.184021 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b17b9-bf8e-49ea-a062-7c531e2911e5 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:15.184798 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc37aff-cc63-43d8-bb31-dfff4fca198b None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-3fc37aff-cc63-43d8-bb31-dfff4fca198b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:15.204237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:15.214333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:15.215650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:15.215650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:15.215650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:15.215650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 266/550] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:15.215650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc37aff-cc63-43d8-bb31-dfff4fca198b None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:15.248025 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddca99e-e21c-45fe-b124-4e1111114a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:15.249329 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca99e-e21c-45fe-b124-4e1111114a6d None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:15.249329 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca99e-e21c-45fe-b124-4e1111114a6d None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:15.249329 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca99e-e21c-45fe-b124-4e1111114a6d None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:15.250142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddca99e-e21c-45fe-b124-4e1111114a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:15.250517 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddca99e-e21c-45fe-b124-4e1111114a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:15.251930 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddca99e-e21c-45fe-b124-4e1111114a6d None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:15.269575 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 285/551] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:15.271977 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddca99e-e21c-45fe-b124-4e1111114a6d None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:15.287430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:15.335943 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc37aff-cc63-43d8-bb31-dfff4fca198b None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:15.366312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:15.380241 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798186d-b9dd-4974-8471-1ccb71a14d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:15.380878 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798186d-b9dd-4974-8471-1ccb71a14d0e None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:15.381160 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798186d-b9dd-4974-8471-1ccb71a14d0e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:15.381713 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0798186d-b9dd-4974-8471-1ccb71a14d0e None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:15.382093 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798186d-b9dd-4974-8471-1ccb71a14d0e None admin] RBAC: Adding query filter params (name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:15.382394 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798186d-b9dd-4974-8471-1ccb71a14d0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:15.383825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0798186d-b9dd-4974-8471-1ccb71a14d0e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:15.393690 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 267/552] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:14:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:15.394581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798186d-b9dd-4974-8471-1ccb71a14d0e None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:15.404828 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddca99e-e21c-45fe-b124-4e1111114a6d None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:15.443971 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502de6e9-3fcc-4fa8-92b8-663e31e6a34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:15.444494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502de6e9-3fcc-4fa8-92b8-663e31e6a34c None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:15.444810 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502de6e9-3fcc-4fa8-92b8-663e31e6a34c None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:15.445088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502de6e9-3fcc-4fa8-92b8-663e31e6a34c None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:15.445732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502de6e9-3fcc-4fa8-92b8-663e31e6a34c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:15.446039 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502de6e9-3fcc-4fa8-92b8-663e31e6a34c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:15.447433 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502de6e9-3fcc-4fa8-92b8-663e31e6a34c None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:15.460963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 286/553] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:15.461817 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502de6e9-3fcc-4fa8-92b8-663e31e6a34c None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:15.516951 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0798186d-b9dd-4974-8471-1ccb71a14d0e None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:15.545038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:15.560940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70d5b8-e225-4d16-8617-91ab771370d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:15.561579 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70d5b8-e225-4d16-8617-91ab771370d1 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:15.561854 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70d5b8-e225-4d16-8617-91ab771370d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:15.562129 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a70d5b8-e225-4d16-8617-91ab771370d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:15.569572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70d5b8-e225-4d16-8617-91ab771370d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:15.571034 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a70d5b8-e225-4d16-8617-91ab771370d1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:15.578756 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502de6e9-3fcc-4fa8-92b8-663e31e6a34c None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-7a70d5b8-e225-4d16-8617-91ab771370d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:15.583112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:15.584642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:15.585738 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:15.585738 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:15.585738 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:15.585738 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:15.585738 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:15.585738 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:15.585738 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:15.585738 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:15.585738 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 268/554] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:15.585738 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70d5b8-e225-4d16-8617-91ab771370d1 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:15.616299 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3fc11-fe7d-4f9a-9506-d2bed4328886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:15.616978 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3fc11-fe7d-4f9a-9506-d2bed4328886 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:15.617262 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3fc11-fe7d-4f9a-9506-d2bed4328886 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:15.617569 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3fc11-fe7d-4f9a-9506-d2bed4328886 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:15.634063 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3fc11-fe7d-4f9a-9506-d2bed4328886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-fae3fc11-fe7d-4f9a-9506-d2bed4328886 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:15.638974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:15.639939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:15.640874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:15.640874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:15.640874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:15.640874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:15.640874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:15.640874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:15.640874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:15.640874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:15.640874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:15.640874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:15.640874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:15.640874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:15.640874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 287/555] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:15.640874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3fc11-fe7d-4f9a-9506-d2bed4328886 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:15.650054 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:15.713171 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a70d5b8-e225-4d16-8617-91ab771370d1 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:15.751778 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3fc11-fe7d-4f9a-9506-d2bed4328886 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:15.753943 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa16652-e7c9-4d28-a259-c26a55c130c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:15.754913 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16652-e7c9-4d28-a259-c26a55c130c6 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:15.755353 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16652-e7c9-4d28-a259-c26a55c130c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:15.755678 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa16652-e7c9-4d28-a259-c26a55c130c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:15.766991 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa16652-e7c9-4d28-a259-c26a55c130c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:15.768584 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa16652-e7c9-4d28-a259-c26a55c130c6 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-0fa16652-e7c9-4d28-a259-c26a55c130c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:15.784495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:15.788985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:15.789868 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:15.789868 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:15.789868 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:15.790036 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:15.790108 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 269/556] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:15.790108 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa16652-e7c9-4d28-a259-c26a55c130c6 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:15.797425 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734b088-8c88-4255-8b2b-272694b3e759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:15.798066 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734b088-8c88-4255-8b2b-272694b3e759 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:15.798344 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734b088-8c88-4255-8b2b-272694b3e759 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:15.798615 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734b088-8c88-4255-8b2b-272694b3e759 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:15.806045 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734b088-8c88-4255-8b2b-272694b3e759 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:15.807562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5734b088-8c88-4255-8b2b-272694b3e759 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-5734b088-8c88-4255-8b2b-272694b3e759 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:15.820488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:15.821679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:15.823077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:15.823077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:15.823077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:15.823077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:15.823077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:15.823077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:15.823077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:15.823077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:15.823077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 03 21:14:15.823077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:15.823077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 288/557] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:14:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:15.823077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734b088-8c88-4255-8b2b-272694b3e759 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:15.924907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:15.933210 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa16652-e7c9-4d28-a259-c26a55c130c6 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:15.941414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734b088-8c88-4255-8b2b-272694b3e759 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:15.968765 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ea4c9-2053-4fab-b5eb-fd3565ebdabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:15.969296 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ea4c9-2053-4fab-b5eb-fd3565ebdabf None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:15.969605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ea4c9-2053-4fab-b5eb-fd3565ebdabf None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:15.969883 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ea4c9-2053-4fab-b5eb-fd3565ebdabf None admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:15.970579 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ea4c9-2053-4fab-b5eb-fd3565ebdabf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:15.970886 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ea4c9-2053-4fab-b5eb-fd3565ebdabf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:15.972372 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ea4c9-2053-4fab-b5eb-fd3565ebdabf None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:15.979248 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19eccec-43a4-4474-9534-be7f699ba8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:15.980700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eccec-43a4-4474-9534-be7f699ba8a2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:15.981040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eccec-43a4-4474-9534-be7f699ba8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:15.981319 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19eccec-43a4-4474-9534-be7f699ba8a2 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:15.982007 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19eccec-43a4-4474-9534-be7f699ba8a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:15.982313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19eccec-43a4-4474-9534-be7f699ba8a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:15.983707 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19eccec-43a4-4474-9534-be7f699ba8a2 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:15.986199 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 270/558] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:15.987072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ea4c9-2053-4fab-b5eb-fd3565ebdabf None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:15.994177 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 289/559] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:14:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:15.994177 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19eccec-43a4-4474-9534-be7f699ba8a2 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:16.054995 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:16.103946 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ea4c9-2053-4fab-b5eb-fd3565ebdabf None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:16.105649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19eccec-43a4-4474-9534-be7f699ba8a2 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:16.140434 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe33930-32b2-4ead-93f6-46a06b26b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:16.141060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe33930-32b2-4ead-93f6-46a06b26b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:16.141338 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe33930-32b2-4ead-93f6-46a06b26b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:16.141605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe33930-32b2-4ead-93f6-46a06b26b4e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:16.142239 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe33930-32b2-4ead-93f6-46a06b26b4e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:16.142541 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe33930-32b2-4ead-93f6-46a06b26b4e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:16.143925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe33930-32b2-4ead-93f6-46a06b26b4e4 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:16.147087 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e4d43-f4e8-4d5f-b179-a99e8a9c0c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:16.147948 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e4d43-f4e8-4d5f-b179-a99e8a9c0c3c None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:16.148224 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e4d43-f4e8-4d5f-b179-a99e8a9c0c3c None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:16.148497 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e4d43-f4e8-4d5f-b179-a99e8a9c0c3c None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:16.149256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e4d43-f4e8-4d5f-b179-a99e8a9c0c3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:16.149560 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e4d43-f4e8-4d5f-b179-a99e8a9c0c3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:16.151020 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e4d43-f4e8-4d5f-b179-a99e8a9c0c3c None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:16.156506 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 271/560] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:16.157521 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe33930-32b2-4ead-93f6-46a06b26b4e4 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:16.170858 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 290/561] 10.222.0.43 () {56 vars in 1137 bytes} [Sat Sep 3 21:14:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:16.171701 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e4d43-f4e8-4d5f-b179-a99e8a9c0c3c None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:16.177164 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:16.263351 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe33930-32b2-4ead-93f6-46a06b26b4e4 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:16.281644 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e4d43-f4e8-4d5f-b179-a99e8a9c0c3c None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:16.293046 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:16.298939 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e15d8a-b103-4967-84c5-82c571cc3eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:16.299609 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e15d8a-b103-4967-84c5-82c571cc3eed None admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:16.304017 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e15d8a-b103-4967-84c5-82c571cc3eed None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:16.304017 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e15d8a-b103-4967-84c5-82c571cc3eed None admin] PATH_INFO: `/v3/projects/3bae29e3189d480c9200f03128f0c607/users/7d95ba5e28764ed49d1142fecb16adab/roles/a591fae52df7454f9d4067c495390a2e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:16.316309 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e15d8a-b103-4967-84c5-82c571cc3eed None admin] RBAC: Authorizing `identity:create_grant(project_id=3bae29e3189d480c9200f03128f0c607, user_id=7d95ba5e28764ed49d1142fecb16adab, role_id=a591fae52df7454f9d4067c495390a2e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:16.317460 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08752480-aa9f-4b11-8090-ba17914034ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:16.317789 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e15d8a-b103-4967-84c5-82c571cc3eed None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:16.318091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08752480-aa9f-4b11-8090-ba17914034ca None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:16.318372 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08752480-aa9f-4b11-8090-ba17914034ca None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:16.318648 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08752480-aa9f-4b11-8090-ba17914034ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:16.328998 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08752480-aa9f-4b11-8090-ba17914034ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:16.330445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08752480-aa9f-4b11-8090-ba17914034ca None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-08752480-aa9f-4b11-8090-ba17914034ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:16.346369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:16.349180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:16.350118 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:16.350118 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:16.350118 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:16.350118 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 291/562] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:16.350118 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08752480-aa9f-4b11-8090-ba17914034ca None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:16.413814 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 272/563] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:14:16 2022] PUT /identity/v3/projects/3bae29e3189d480c9200f03128f0c607/users/7d95ba5e28764ed49d1142fecb16adab/roles/a591fae52df7454f9d4067c495390a2e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:14:16.414884 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e15d8a-b103-4967-84c5-82c571cc3eed None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:16.461796 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08752480-aa9f-4b11-8090-ba17914034ca None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:16.504656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c3542-c6eb-4d8a-9984-82dd3b5c39d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:16.505335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c3542-c6eb-4d8a-9984-82dd3b5c39d0 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:16.505586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c3542-c6eb-4d8a-9984-82dd3b5c39d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:16.505859 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c3542-c6eb-4d8a-9984-82dd3b5c39d0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:16.507282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:16.521659 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c3542-c6eb-4d8a-9984-82dd3b5c39d0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:16.521659 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c3542-c6eb-4d8a-9984-82dd3b5c39d0 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-fc3c3542-c6eb-4d8a-9984-82dd3b5c39d0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:16.530958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:16.532189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:16.533785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:16.533785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:16.533785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:16.533785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:16.533785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:16.533785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:16.533785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:16.533785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:16.533785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 21:14:16.533785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:16.533785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 292/564] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:14:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:16.533785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c3542-c6eb-4d8a-9984-82dd3b5c39d0 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:16.556962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e15d8a-b103-4967-84c5-82c571cc3eed None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:16.563718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:16.600144 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594fcea-42b4-447b-b919-8756e14fd383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:16.600826 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594fcea-42b4-447b-b919-8756e14fd383 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:16.601163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594fcea-42b4-447b-b919-8756e14fd383 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:16.601443 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594fcea-42b4-447b-b919-8756e14fd383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:16.616670 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594fcea-42b4-447b-b919-8756e14fd383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:16.618215 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594fcea-42b4-447b-b919-8756e14fd383 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-9594fcea-42b4-447b-b919-8756e14fd383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:16.637312 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:16.638370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:16.639706 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:16.639706 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:16.639706 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:16.639706 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 273/565] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:16.639706 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594fcea-42b4-447b-b919-8756e14fd383 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:16.659181 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c3542-c6eb-4d8a-9984-82dd3b5c39d0 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:16.698989 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdadf2-6b72-4234-94f6-f5bff2b99929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:16.700415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdadf2-6b72-4234-94f6-f5bff2b99929 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:16.700415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdadf2-6b72-4234-94f6-f5bff2b99929 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:16.700415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdadf2-6b72-4234-94f6-f5bff2b99929 None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:16.700977 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdadf2-6b72-4234-94f6-f5bff2b99929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:16.701335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdadf2-6b72-4234-94f6-f5bff2b99929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:16.702882 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfdadf2-6b72-4234-94f6-f5bff2b99929 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:16.728274 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 293/566] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:16.730081 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdadf2-6b72-4234-94f6-f5bff2b99929 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:16.760455 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594fcea-42b4-447b-b919-8756e14fd383 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:16.782141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:16.801951 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b845a-70e0-4798-90af-f941950c7aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:16.802713 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b845a-70e0-4798-90af-f941950c7aad None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:16.803096 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b845a-70e0-4798-90af-f941950c7aad None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:16.803475 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b845a-70e0-4798-90af-f941950c7aad None admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:16.804314 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b845a-70e0-4798-90af-f941950c7aad None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:16.804791 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b845a-70e0-4798-90af-f941950c7aad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:16.806582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b845a-70e0-4798-90af-f941950c7aad None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:16.821900 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:16.833765 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 274/567] 10.222.0.43 () {56 vars in 1137 bytes} [Sat Sep 3 21:14:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:16.833765 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b845a-70e0-4798-90af-f941950c7aad None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:16.846374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfdadf2-6b72-4234-94f6-f5bff2b99929 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:16.884680 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cf77f-5955-40e2-bc80-9e98230c36dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:16.885307 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cf77f-5955-40e2-bc80-9e98230c36dd None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:16.885577 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cf77f-5955-40e2-bc80-9e98230c36dd None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:16.886069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cf77f-5955-40e2-bc80-9e98230c36dd None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:16.886722 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cf77f-5955-40e2-bc80-9e98230c36dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:16.887026 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cf77f-5955-40e2-bc80-9e98230c36dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:16.888409 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cf77f-5955-40e2-bc80-9e98230c36dd None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:16.905842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 294/568] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:16.905842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cf77f-5955-40e2-bc80-9e98230c36dd None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:16.959327 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b845a-70e0-4798-90af-f941950c7aad None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:16.996861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b14f09-72a6-4a11-a8e6-88c993d7b44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:16.997497 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b14f09-72a6-4a11-a8e6-88c993d7b44e None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:16.997779 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b14f09-72a6-4a11-a8e6-88c993d7b44e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:16.998049 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b14f09-72a6-4a11-a8e6-88c993d7b44e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:17.006294 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b14f09-72a6-4a11-a8e6-88c993d7b44e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:17.007751 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b14f09-72a6-4a11-a8e6-88c993d7b44e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:17.023308 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cf77f-5955-40e2-bc80-9e98230c36dd None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-f7b14f09-72a6-4a11-a8e6-88c993d7b44e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:17.029605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:17.030581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:17.031498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:17.031498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:17.031498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:17.031498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:17.031498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:17.031498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:17.031498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:17.031498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:17.031498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 21:14:17.031498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:17.032940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 275/569] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:17.033774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b14f09-72a6-4a11-a8e6-88c993d7b44e None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:17.064762 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d672c9-e740-4d3d-9af3-d0d067e6d984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:17.065482 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d672c9-e740-4d3d-9af3-d0d067e6d984 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:17.065750 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d672c9-e740-4d3d-9af3-d0d067e6d984 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:17.066021 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d672c9-e740-4d3d-9af3-d0d067e6d984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:17.073563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:17.082923 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d672c9-e740-4d3d-9af3-d0d067e6d984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:17.088246 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d672c9-e740-4d3d-9af3-d0d067e6d984 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:17.088246 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-96d672c9-e740-4d3d-9af3-d0d067e6d984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:17.103681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:17.105780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:17.106865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:17.106865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:17.106865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:17.106865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 295/570] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:17.106865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d672c9-e740-4d3d-9af3-d0d067e6d984 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:17.153737 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b14f09-72a6-4a11-a8e6-88c993d7b44e None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:17.191510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c952eba-83b3-4621-a64c-c528d5ca1168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:17.192222 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c952eba-83b3-4621-a64c-c528d5ca1168 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:17.192611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c952eba-83b3-4621-a64c-c528d5ca1168 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:17.192901 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c952eba-83b3-4621-a64c-c528d5ca1168 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:17.201002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c952eba-83b3-4621-a64c-c528d5ca1168 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:17.202476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c952eba-83b3-4621-a64c-c528d5ca1168 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-6c952eba-83b3-4621-a64c-c528d5ca1168 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:17.214265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:17.215260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:17.220999 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:17.220999 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:17.220999 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:17.220999 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:17.220999 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:17.220999 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:17.220999 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:17.220999 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:17.221473 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d672c9-e740-4d3d-9af3-d0d067e6d984 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:17.221549 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 276/571] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:17.221549 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c952eba-83b3-4621-a64c-c528d5ca1168 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:17.267277 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8ae2d-fdcd-4614-8ec6-d93cb2a463a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:17.267920 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8ae2d-fdcd-4614-8ec6-d93cb2a463a3 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:17.268222 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8ae2d-fdcd-4614-8ec6-d93cb2a463a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:17.268492 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8ae2d-fdcd-4614-8ec6-d93cb2a463a3 None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:17.269280 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8ae2d-fdcd-4614-8ec6-d93cb2a463a3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:17.269588 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8ae2d-fdcd-4614-8ec6-d93cb2a463a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:17.271070 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8ae2d-fdcd-4614-8ec6-d93cb2a463a3 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:17.290165 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 296/572] 10.222.0.43 () {56 vars in 1139 bytes} [Sat Sep 3 21:14:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:17.290762 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8ae2d-fdcd-4614-8ec6-d93cb2a463a3 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:17.343022 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:17.351509 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c952eba-83b3-4621-a64c-c528d5ca1168 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:17.378136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:17.410505 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35020690-b4fe-411d-916a-2a7479fe4e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:17.411446 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35020690-b4fe-411d-916a-2a7479fe4e55 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:17.411890 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35020690-b4fe-411d-916a-2a7479fe4e55 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:17.412330 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35020690-b4fe-411d-916a-2a7479fe4e55 None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:17.413456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35020690-b4fe-411d-916a-2a7479fe4e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:17.413965 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35020690-b4fe-411d-916a-2a7479fe4e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:17.416573 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35020690-b4fe-411d-916a-2a7479fe4e55 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:17.432323 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 277/573] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:17.433551 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35020690-b4fe-411d-916a-2a7479fe4e55 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:17.456326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8ae2d-fdcd-4614-8ec6-d93cb2a463a3 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:17.497290 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b903d5c-8763-4e14-9537-7c64e0c0077b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:17.498262 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b903d5c-8763-4e14-9537-7c64e0c0077b None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:17.498621 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b903d5c-8763-4e14-9537-7c64e0c0077b None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:17.498897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b903d5c-8763-4e14-9537-7c64e0c0077b None admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:17.499613 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b903d5c-8763-4e14-9537-7c64e0c0077b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:17.499916 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b903d5c-8763-4e14-9537-7c64e0c0077b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:17.501386 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b903d5c-8763-4e14-9537-7c64e0c0077b None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:17.513825 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 297/574] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:17.514728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b903d5c-8763-4e14-9537-7c64e0c0077b None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:17.553742 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35020690-b4fe-411d-916a-2a7479fe4e55 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:17.591509 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b79531-4914-47bd-97fb-71ec42986ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:17.592142 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b79531-4914-47bd-97fb-71ec42986ca4 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:17.592423 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b79531-4914-47bd-97fb-71ec42986ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:17.592717 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b79531-4914-47bd-97fb-71ec42986ca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:17.608262 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b79531-4914-47bd-97fb-71ec42986ca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:17.609722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b79531-4914-47bd-97fb-71ec42986ca4 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-37b79531-4914-47bd-97fb-71ec42986ca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:17.625348 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:17.626531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:17.627440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:17.627440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:17.627440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:17.627440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 278/575] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:17.627440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b79531-4914-47bd-97fb-71ec42986ca4 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:17.639183 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:17.639358 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b903d5c-8763-4e14-9537-7c64e0c0077b None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:17.654128 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:17.681636 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74489a2b-c751-44dc-8772-67a831149750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:17.682238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74489a2b-c751-44dc-8772-67a831149750 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:17.682498 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74489a2b-c751-44dc-8772-67a831149750 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:17.683204 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74489a2b-c751-44dc-8772-67a831149750 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:17.690505 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74489a2b-c751-44dc-8772-67a831149750 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:17.692172 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74489a2b-c751-44dc-8772-67a831149750 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-74489a2b-c751-44dc-8772-67a831149750 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:17.704419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:17.705457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:17.706344 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:17.706344 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:17.706344 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:17.706344 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:17.706344 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:17.706344 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:17.706344 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:17.706344 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:17.706344 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 298/576] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:17.706838 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74489a2b-c751-44dc-8772-67a831149750 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:17.744508 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b79531-4914-47bd-97fb-71ec42986ca4 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:17.784928 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9440264-9c1b-45cb-97b6-782742a9809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:17.785586 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9440264-9c1b-45cb-97b6-782742a9809d None admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:17.786668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9440264-9c1b-45cb-97b6-782742a9809d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:17.786668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9440264-9c1b-45cb-97b6-782742a9809d None admin] PATH_INFO: `/v3/projects/3bae29e3189d480c9200f03128f0c607/users/c05e9121d1bc48d497410de13a07b198/roles/a591fae52df7454f9d4067c495390a2e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:17.817194 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74489a2b-c751-44dc-8772-67a831149750 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:17.888033 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9440264-9c1b-45cb-97b6-782742a9809d None admin] RBAC: Authorizing `identity:create_grant(project_id=3bae29e3189d480c9200f03128f0c607, user_id=c05e9121d1bc48d497410de13a07b198, role_id=a591fae52df7454f9d4067c495390a2e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:17.889532 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9440264-9c1b-45cb-97b6-782742a9809d None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:17.908373 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b098d-4791-43a2-8478-d5d16903794b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:17.909006 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b098d-4791-43a2-8478-d5d16903794b None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:17.913268 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b098d-4791-43a2-8478-d5d16903794b None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:17.913268 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b098d-4791-43a2-8478-d5d16903794b None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:17.913268 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b098d-4791-43a2-8478-d5d16903794b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:17.913268 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b098d-4791-43a2-8478-d5d16903794b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:17.913268 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b098d-4791-43a2-8478-d5d16903794b None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:17.924666 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 299/577] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:17.929791 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b098d-4791-43a2-8478-d5d16903794b None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:17.962207 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:17.996454 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 279/578] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:14:17 2022] PUT /identity/v3/projects/3bae29e3189d480c9200f03128f0c607/users/c05e9121d1bc48d497410de13a07b198/roles/a591fae52df7454f9d4067c495390a2e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:14:17.997743 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9440264-9c1b-45cb-97b6-782742a9809d None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:18.043510 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b098d-4791-43a2-8478-d5d16903794b None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:18.094065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a815907-b541-461c-ad36-d961aa178157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:18.094843 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a815907-b541-461c-ad36-d961aa178157 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:18.095253 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a815907-b541-461c-ad36-d961aa178157 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:18.095620 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a815907-b541-461c-ad36-d961aa178157 None admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:18.096551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a815907-b541-461c-ad36-d961aa178157 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:18.097622 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a815907-b541-461c-ad36-d961aa178157 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:18.101891 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a815907-b541-461c-ad36-d961aa178157 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:18.113873 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 300/579] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:18.122137 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a815907-b541-461c-ad36-d961aa178157 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:18.132325 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:18.194753 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9440264-9c1b-45cb-97b6-782742a9809d None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:18.248055 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4e403-7533-4dd8-bfee-c395ec2ddcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:18.249038 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4e403-7533-4dd8-bfee-c395ec2ddcc5 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:18.249324 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4e403-7533-4dd8-bfee-c395ec2ddcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:18.249865 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4e403-7533-4dd8-bfee-c395ec2ddcc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:18.251019 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:18.260175 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4e403-7533-4dd8-bfee-c395ec2ddcc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:18.262469 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4e403-7533-4dd8-bfee-c395ec2ddcc5 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:18.265755 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a815907-b541-461c-ad36-d961aa178157 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-4dd4e403-7533-4dd8-bfee-c395ec2ddcc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:18.281110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:18.282237 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:18.283317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:18.283317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:18.283317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:18.283317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:18.283317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:18.283317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:18.283317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:18.283317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:18.286381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 280/580] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:18.293567 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4e403-7533-4dd8-bfee-c395ec2ddcc5 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:18.312239 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92b7a1-39c0-4a23-b43d-99eca5441b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:18.313018 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92b7a1-39c0-4a23-b43d-99eca5441b1a None admin] REQUEST_METHOD: `PUT` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:18.313383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92b7a1-39c0-4a23-b43d-99eca5441b1a None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:18.313752 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92b7a1-39c0-4a23-b43d-99eca5441b1a None admin] PATH_INFO: `/v3/projects/3bae29e3189d480c9200f03128f0c607/users/90cd1e165f3c4eba95dc93a25011b695/roles/a591fae52df7454f9d4067c495390a2e` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:18.335017 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92b7a1-39c0-4a23-b43d-99eca5441b1a None admin] RBAC: Authorizing `identity:create_grant(project_id=3bae29e3189d480c9200f03128f0c607, user_id=90cd1e165f3c4eba95dc93a25011b695, role_id=a591fae52df7454f9d4067c495390a2e)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:18.336999 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92b7a1-39c0-4a23-b43d-99eca5441b1a None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:18.412796 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4e403-7533-4dd8-bfee-c395ec2ddcc5 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:18.431628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:18.450249 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4187e9-752c-4fb8-8a4c-d14ba9a64e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:18.450868 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4187e9-752c-4fb8-8a4c-d14ba9a64e81 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:18.451148 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4187e9-752c-4fb8-8a4c-d14ba9a64e81 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:18.451430 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4187e9-752c-4fb8-8a4c-d14ba9a64e81 None admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:18.452122 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4187e9-752c-4fb8-8a4c-d14ba9a64e81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:18.452433 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4187e9-752c-4fb8-8a4c-d14ba9a64e81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:18.453944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4187e9-752c-4fb8-8a4c-d14ba9a64e81 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:18.472592 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 281/582] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:18.473117 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 301/582] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:14:18 2022] PUT /identity/v3/projects/3bae29e3189d480c9200f03128f0c607/users/90cd1e165f3c4eba95dc93a25011b695/roles/a591fae52df7454f9d4067c495390a2e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 21:14:18.485723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4187e9-752c-4fb8-8a4c-d14ba9a64e81 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:18.616339 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4187e9-752c-4fb8-8a4c-d14ba9a64e81 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:18.661187 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf231380-5bad-4c47-9794-ea912e38827f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:18.662328 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf231380-5bad-4c47-9794-ea912e38827f None admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:18.663032 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf231380-5bad-4c47-9794-ea912e38827f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:18.663489 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf231380-5bad-4c47-9794-ea912e38827f None admin] PATH_INFO: `/v3/projects/3bae29e3189d480c9200f03128f0c607/users/a969a77183c34a7e9eff28636b1170c3/roles/a591fae52df7454f9d4067c495390a2e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:18.685240 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf231380-5bad-4c47-9794-ea912e38827f None admin] RBAC: Authorizing `identity:create_grant(project_id=3bae29e3189d480c9200f03128f0c607, user_id=a969a77183c34a7e9eff28636b1170c3, role_id=a591fae52df7454f9d4067c495390a2e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:18.686726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf231380-5bad-4c47-9794-ea912e38827f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:18.705543 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4717797-d218-4b6c-848e-482a37f4b78e None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:18.705838 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4717797-d218-4b6c-848e-482a37f4b78e None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:18.706101 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4717797-d218-4b6c-848e-482a37f4b78e None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:18.707486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 302/583] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:14:18.715385 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee25ec7-11ff-4c28-adf8-7153b3185de5 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:18.715699 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee25ec7-11ff-4c28-adf8-7153b3185de5 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:18.715947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee25ec7-11ff-4c28-adf8-7153b3185de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:18.735888 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-6ee25ec7-11ff-4c28-adf8-7153b3185de5 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:18.737147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-6ee25ec7-11ff-4c28-adf8-7153b3185de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:18.764466 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 282/584] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:14:18 2022] PUT /identity/v3/projects/3bae29e3189d480c9200f03128f0c607/users/a969a77183c34a7e9eff28636b1170c3/roles/a591fae52df7454f9d4067c495390a2e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:14:18.835507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 303/585] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:14:19.185457 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf231380-5bad-4c47-9794-ea912e38827f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:19.220231 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:19.306397 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf231380-5bad-4c47-9794-ea912e38827f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:19.347212 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e2800-2987-4303-b532-65a48ccc7341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:19.348233 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e2800-2987-4303-b532-65a48ccc7341 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:19.348773 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e2800-2987-4303-b532-65a48ccc7341 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:19.349247 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e2800-2987-4303-b532-65a48ccc7341 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:19.360891 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e2800-2987-4303-b532-65a48ccc7341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-948e2800-2987-4303-b532-65a48ccc7341 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:19.365929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:19.366896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:19.367726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:19.367726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:19.367726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:19.367726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:19.367726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:19.367726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:19.367726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:19.367726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:19.367726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:19.367726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:19.367726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:19.367726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:19.371115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 283/586] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:19.377654 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee25ec7-11ff-4c28-adf8-7153b3185de5 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:19.460565 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:19.490814 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee25ec7-11ff-4c28-adf8-7153b3185de5 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:19.528644 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb858981-fab6-400c-a296-923aa8d0fe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:19.529262 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb858981-fab6-400c-a296-923aa8d0fe1e None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:19.529547 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb858981-fab6-400c-a296-923aa8d0fe1e None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:19.529823 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb858981-fab6-400c-a296-923aa8d0fe1e None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:19.530491 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb858981-fab6-400c-a296-923aa8d0fe1e None admin] RBAC: Adding query filter params (name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:19.530795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb858981-fab6-400c-a296-923aa8d0fe1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:19.532281 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb858981-fab6-400c-a296-923aa8d0fe1e None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:19.546374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 304/587] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:14:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:19.548121 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e2800-2987-4303-b532-65a48ccc7341 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:19.649096 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:19.662587 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e2800-2987-4303-b532-65a48ccc7341 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:19.704555 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c43dd-f2b0-484a-a47e-ab144b8eade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:19.704555 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c43dd-f2b0-484a-a47e-ab144b8eade4 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:19.704555 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c43dd-f2b0-484a-a47e-ab144b8eade4 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:19.704555 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c43dd-f2b0-484a-a47e-ab144b8eade4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:19.716552 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c43dd-f2b0-484a-a47e-ab144b8eade4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:19.716880 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c43dd-f2b0-484a-a47e-ab144b8eade4 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-050c43dd-f2b0-484a-a47e-ab144b8eade4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:19.736556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:19.738839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:19.741007 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:19.741007 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:19.741007 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:19.741007 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 284/588] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:19.741529 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb858981-fab6-400c-a296-923aa8d0fe1e None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:19.860119 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb858981-fab6-400c-a296-923aa8d0fe1e None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:19.898548 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c9952-44e2-4874-a080-ed31c7cd6e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:19.899227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c9952-44e2-4874-a080-ed31c7cd6e0e None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:19.899454 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c9952-44e2-4874-a080-ed31c7cd6e0e None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:19.899731 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c9952-44e2-4874-a080-ed31c7cd6e0e None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:19.900378 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c9952-44e2-4874-a080-ed31c7cd6e0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:19.900783 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c9952-44e2-4874-a080-ed31c7cd6e0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:19.902228 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c9952-44e2-4874-a080-ed31c7cd6e0e None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:19.903791 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:19.920680 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 305/589] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:19.922096 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c43dd-f2b0-484a-a47e-ab144b8eade4 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:20.049396 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c43dd-f2b0-484a-a47e-ab144b8eade4 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:20.098368 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe849011-552d-4952-bfce-c61dee80e976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:20.099545 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe849011-552d-4952-bfce-c61dee80e976 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:20.100073 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe849011-552d-4952-bfce-c61dee80e976 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:20.100585 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe849011-552d-4952-bfce-c61dee80e976 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:20.114256 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe849011-552d-4952-bfce-c61dee80e976 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:20.115758 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe849011-552d-4952-bfce-c61dee80e976 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:20.119018 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-fe849011-552d-4952-bfce-c61dee80e976 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:20.133948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:20.135037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:20.136097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:20.136097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:20.136097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:20.136097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:20.136097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:20.136097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:20.136097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:20.136097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:20.136097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 21:14:20.136097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:20.143385 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 285/590] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Sep 3 21:14:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:20.145182 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c9952-44e2-4874-a080-ed31c7cd6e0e None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:20.272664 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c9952-44e2-4874-a080-ed31c7cd6e0e None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:20.313080 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c29eb-eacc-42fe-a1ae-f6698c065136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:20.314187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c29eb-eacc-42fe-a1ae-f6698c065136 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:20.314680 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c29eb-eacc-42fe-a1ae-f6698c065136 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:20.315183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c29eb-eacc-42fe-a1ae-f6698c065136 None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:20.316217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c29eb-eacc-42fe-a1ae-f6698c065136 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:20.316775 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c29eb-eacc-42fe-a1ae-f6698c065136 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:20.318404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c29eb-eacc-42fe-a1ae-f6698c065136 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:20.343641 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 306/591] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Sep 3 21:14:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:20.345410 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe849011-552d-4952-bfce-c61dee80e976 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:20.348351 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f9f90-7287-4156-aaaa-fdd1de3439d3 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:20.348685 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f9f90-7287-4156-aaaa-fdd1de3439d3 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:20.348966 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f9f90-7287-4156-aaaa-fdd1de3439d3 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:20.350421 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 307/592] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:20.356209 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86604a-e92f-40f8-832f-a04773350c94 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:20.356491 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86604a-e92f-40f8-832f-a04773350c94 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:20.356805 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86604a-e92f-40f8-832f-a04773350c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:20.377392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-0b86604a-e92f-40f8-832f-a04773350c94 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:20.378706 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-0b86604a-e92f-40f8-832f-a04773350c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:20.437264 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:20.464941 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 308/593] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:14:20.487624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe849011-552d-4952-bfce-c61dee80e976 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:20.533031 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083c18e-3954-46dd-836b-ec16a36dbfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:20.534004 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083c18e-3954-46dd-836b-ec16a36dbfd1 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:20.534490 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083c18e-3954-46dd-836b-ec16a36dbfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:20.534965 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083c18e-3954-46dd-836b-ec16a36dbfd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:20.608364 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:20.611490 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083c18e-3954-46dd-836b-ec16a36dbfd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:20.613227 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083c18e-3954-46dd-836b-ec16a36dbfd1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:20.735474 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 286/594] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:20.741285 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86604a-e92f-40f8-832f-a04773350c94 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:20.813895 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083c18e-3954-46dd-836b-ec16a36dbfd1 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:20.871004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b86604a-e92f-40f8-832f-a04773350c94 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:20.911500 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc7a2e-498e-4708-9ddb-3f6277618214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:20.912140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc7a2e-498e-4708-9ddb-3f6277618214 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:20.912422 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc7a2e-498e-4708-9ddb-3f6277618214 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:20.912726 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc7a2e-498e-4708-9ddb-3f6277618214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:20.926379 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc7a2e-498e-4708-9ddb-3f6277618214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:20.927861 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc7a2e-498e-4708-9ddb-3f6277618214 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:20.935916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:20.940153 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083c18e-3954-46dd-836b-ec16a36dbfd1 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-23dc7a2e-498e-4708-9ddb-3f6277618214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:20.946202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:20.957703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:20.958605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:20.958605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:20.958605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:20.958605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 309/595] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:20.958605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3aef-53e6-4015-bfdc-dba33ff5ae99 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:20.958605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3aef-53e6-4015-bfdc-dba33ff5ae99 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:20.958605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3aef-53e6-4015-bfdc-dba33ff5ae99 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:20.958605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 310/596] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:20.958605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc3aef-53e6-4015-bfdc-dba33ff5ae99 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:20.994002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a56dd-2039-4336-9846-4e46af22f554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:20.994782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a56dd-2039-4336-9846-4e46af22f554 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:20.995061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a56dd-2039-4336-9846-4e46af22f554 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:20.995958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a56dd-2039-4336-9846-4e46af22f554 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:21.001407 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:21.013949 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a56dd-2039-4336-9846-4e46af22f554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-f35a56dd-2039-4336-9846-4e46af22f554 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:21.019289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:21.021172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:21.022202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:21.022202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:21.022202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:21.022202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:21.022202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:21.022202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:21.022202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:21.022202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:21.022202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:21.022202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:21.022202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:21.022202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:21.022202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 287/597] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:14:21.024396 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57fb68-3e22-45e9-b666-184eb0468564 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:21.024396 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57fb68-3e22-45e9-b666-184eb0468564 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:21.024766 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57fb68-3e22-45e9-b666-184eb0468564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:21.047026 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-6f57fb68-3e22-45e9-b666-184eb0468564 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:21.048775 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-6f57fb68-3e22-45e9-b666-184eb0468564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:21.116697 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc3aef-53e6-4015-bfdc-dba33ff5ae99 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:21.173620 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 288/598] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:21.175415 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57fb68-3e22-45e9-b666-184eb0468564 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:21.177812 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78368c93-c9b7-4949-a7ff-e423f51088d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:21.178846 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78368c93-c9b7-4949-a7ff-e423f51088d3 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:21.179359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78368c93-c9b7-4949-a7ff-e423f51088d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:21.179874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78368c93-c9b7-4949-a7ff-e423f51088d3 None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:21.180916 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78368c93-c9b7-4949-a7ff-e423f51088d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:21.181272 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78368c93-c9b7-4949-a7ff-e423f51088d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:21.183897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78368c93-c9b7-4949-a7ff-e423f51088d3 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:21.207715 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 311/599] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:21.207715 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c7cd-8e0d-4ccb-9665-95a9b2c8f110 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:21.207715 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c7cd-8e0d-4ccb-9665-95a9b2c8f110 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:21.207715 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172c7cd-8e0d-4ccb-9665-95a9b2c8f110 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:21.207715 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 312/600] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:21.211147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172c7cd-8e0d-4ccb-9665-95a9b2c8f110 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:21.331858 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:21.341183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172c7cd-8e0d-4ccb-9665-95a9b2c8f110 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:21.342995 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:21.359010 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57fb68-3e22-45e9-b666-184eb0468564 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:21.385751 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bb78e-2102-4aad-83cf-acbfeb7a61f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:21.385751 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bb78e-2102-4aad-83cf-acbfeb7a61f1 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:21.385751 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bb78e-2102-4aad-83cf-acbfeb7a61f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:21.385751 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bb78e-2102-4aad-83cf-acbfeb7a61f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:21.392905 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bb78e-2102-4aad-83cf-acbfeb7a61f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:21.394795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bb78e-2102-4aad-83cf-acbfeb7a61f1 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-139bb78e-2102-4aad-83cf-acbfeb7a61f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:21.407306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:21.408352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:21.414100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:21.414100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:21.414100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:21.414100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:21.414100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:21.414100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:21.414100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:21.414100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:21.414100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 313/601] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:21.414100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e2d19-d480-4562-93d6-7e0e9eec06db None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:21.414100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e2d19-d480-4562-93d6-7e0e9eec06db None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:21.415577 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e2d19-d480-4562-93d6-7e0e9eec06db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:21.427176 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335f4a4-72df-482a-a015-f62844e9f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:21.428375 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335f4a4-72df-482a-a015-f62844e9f6d4 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:21.428375 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335f4a4-72df-482a-a015-f62844e9f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:21.428588 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335f4a4-72df-482a-a015-f62844e9f6d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:21.429362 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335f4a4-72df-482a-a015-f62844e9f6d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:21.429848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335f4a4-72df-482a-a015-f62844e9f6d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:21.430451 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-991e2d19-d480-4562-93d6-7e0e9eec06db None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:21.431614 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335f4a4-72df-482a-a015-f62844e9f6d4 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:21.431771 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-991e2d19-d480-4562-93d6-7e0e9eec06db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:21.444589 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 289/602] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:14:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:21.444589 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335f4a4-72df-482a-a015-f62844e9f6d4 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:21.521269 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 314/603] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:21.522158 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e2d19-d480-4562-93d6-7e0e9eec06db None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:21.570497 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335f4a4-72df-482a-a015-f62844e9f6d4 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:21.613204 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832ab68-501b-4099-8f61-ac497a4a99a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:21.613837 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832ab68-501b-4099-8f61-ac497a4a99a3 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:21.614112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832ab68-501b-4099-8f61-ac497a4a99a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:21.614501 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832ab68-501b-4099-8f61-ac497a4a99a3 None admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:21.615196 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832ab68-501b-4099-8f61-ac497a4a99a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:21.615544 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832ab68-501b-4099-8f61-ac497a4a99a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:21.617120 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4832ab68-501b-4099-8f61-ac497a4a99a3 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:21.626685 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:21.640807 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 290/604] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:21.640807 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832ab68-501b-4099-8f61-ac497a4a99a3 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:21.650606 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e2d19-d480-4562-93d6-7e0e9eec06db None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:21.658611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:21.691756 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2996f1d-4189-4f50-8d01-f858247935d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:21.692348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996f1d-4189-4f50-8d01-f858247935d7 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:21.692514 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996f1d-4189-4f50-8d01-f858247935d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:21.692831 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2996f1d-4189-4f50-8d01-f858247935d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:21.708593 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2996f1d-4189-4f50-8d01-f858247935d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:21.709261 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2996f1d-4189-4f50-8d01-f858247935d7 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-e2996f1d-4189-4f50-8d01-f858247935d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:21.726603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:21.728215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:21.730604 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:21.730604 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:21.730604 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:21.730604 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 315/605] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:21.733455 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2996f1d-4189-4f50-8d01-f858247935d7 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:21.791558 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832ab68-501b-4099-8f61-ac497a4a99a3 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:21.833228 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c3b19-2897-46f5-b707-4ff1eb199e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:21.834357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c3b19-2897-46f5-b707-4ff1eb199e7d None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:21.834357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c3b19-2897-46f5-b707-4ff1eb199e7d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:21.834357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c3b19-2897-46f5-b707-4ff1eb199e7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:21.846285 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c3b19-2897-46f5-b707-4ff1eb199e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-b87c3b19-2897-46f5-b707-4ff1eb199e7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:21.851146 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:21.852712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:21.854078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:21.854078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:21.854078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:21.854078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:21.854078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:21.854078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:21.854078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:21.854078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:21.854078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:21.854078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:21.854078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:21.854078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:21.854078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 291/606] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:21.854078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c3b19-2897-46f5-b707-4ff1eb199e7d None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:21.866306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2996f1d-4189-4f50-8d01-f858247935d7 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:21.904837 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d537f3e-9e16-47ce-9fbc-c02478779203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:21.905372 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537f3e-9e16-47ce-9fbc-c02478779203 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:21.905658 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537f3e-9e16-47ce-9fbc-c02478779203 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:21.905929 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d537f3e-9e16-47ce-9fbc-c02478779203 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:21.906648 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d537f3e-9e16-47ce-9fbc-c02478779203 None admin] RBAC: Adding query filter params (role.id=a591fae52df7454f9d4067c495390a2e, scope.project.id=3bae29e3189d480c9200f03128f0c607, user.id=7d95ba5e28764ed49d1142fecb16adab) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:21.906950 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d537f3e-9e16-47ce-9fbc-c02478779203 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:21.908381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d537f3e-9e16-47ce-9fbc-c02478779203 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:21.911550 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:21.928557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 316/607] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:14:21 2022] GET /identity/v3/role_assignments?user.id=7d95ba5e28764ed49d1142fecb16adab&scope.project.id=3bae29e3189d480c9200f03128f0c607&role.id=a591fae52df7454f9d4067c495390a2e => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:21.928557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d537f3e-9e16-47ce-9fbc-c02478779203 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:21.947522 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:21.992468 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c3b19-2897-46f5-b707-4ff1eb199e7d None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:22.052280 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53ec63-7faa-4a3d-b971-40e348d097ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:22.053273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53ec63-7faa-4a3d-b971-40e348d097ca None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:22.053273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53ec63-7faa-4a3d-b971-40e348d097ca None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:22.053468 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53ec63-7faa-4a3d-b971-40e348d097ca None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:22.054107 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53ec63-7faa-4a3d-b971-40e348d097ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:22.054496 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53ec63-7faa-4a3d-b971-40e348d097ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:22.055913 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53ec63-7faa-4a3d-b971-40e348d097ca None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:22.062268 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d537f3e-9e16-47ce-9fbc-c02478779203 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:22.076655 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 292/608] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:22.076655 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53ec63-7faa-4a3d-b971-40e348d097ca None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:22.109240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a567a2-cb55-4ce1-a99f-e0482eddf451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:22.109861 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a567a2-cb55-4ce1-a99f-e0482eddf451 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:22.110146 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a567a2-cb55-4ce1-a99f-e0482eddf451 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:22.110424 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a567a2-cb55-4ce1-a99f-e0482eddf451 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:22.111104 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a567a2-cb55-4ce1-a99f-e0482eddf451 None admin] RBAC: Adding query filter params (name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:22.111410 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a567a2-cb55-4ce1-a99f-e0482eddf451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:22.112867 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a567a2-cb55-4ce1-a99f-e0482eddf451 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:22.126423 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 317/609] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:14:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:22.127313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a567a2-cb55-4ce1-a99f-e0482eddf451 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:22.205453 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:22.215947 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53ec63-7faa-4a3d-b971-40e348d097ca None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:22.250375 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a567a2-cb55-4ce1-a99f-e0482eddf451 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:22.252198 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:22.257441 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b307c-e944-4647-b2d8-af8559fd7e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:22.258141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b307c-e944-4647-b2d8-af8559fd7e16 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:22.258400 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b307c-e944-4647-b2d8-af8559fd7e16 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:22.258645 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b307c-e944-4647-b2d8-af8559fd7e16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:22.270810 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b307c-e944-4647-b2d8-af8559fd7e16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-6f9b307c-e944-4647-b2d8-af8559fd7e16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:22.275940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:22.277092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:22.278263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:22.278263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:22.278263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:22.278263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:22.278263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:22.278263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:22.278263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:22.278263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:22.278263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:22.278263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:22.278263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:14:22.278263 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:22.282240 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 293/610] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:22.282667 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b307c-e944-4647-b2d8-af8559fd7e16 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:22.290201 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da7e5b-9b22-4dbc-bee8-1fdac451c80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:22.290956 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da7e5b-9b22-4dbc-bee8-1fdac451c80f None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:22.291302 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da7e5b-9b22-4dbc-bee8-1fdac451c80f None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:22.291682 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da7e5b-9b22-4dbc-bee8-1fdac451c80f None admin] PATH_INFO: `/v3/users/glance` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:22.301079 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da7e5b-9b22-4dbc-bee8-1fdac451c80f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:22.302631 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da7e5b-9b22-4dbc-bee8-1fdac451c80f None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-f1da7e5b-9b22-4dbc-bee8-1fdac451c80f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:22.315258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:22.316611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:22.322374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:22.322374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:22.322374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:22.322374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:22.322374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:22.322374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:22.322374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:22.322374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:22.322374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 03 21:14:22.322374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:22.322374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 318/611] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:14:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:22.322374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da7e5b-9b22-4dbc-bee8-1fdac451c80f None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:22.419204 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b307c-e944-4647-b2d8-af8559fd7e16 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:22.448215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da7e5b-9b22-4dbc-bee8-1fdac451c80f None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:22.462876 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deda180-9f5d-4f85-b9fb-ac32eb51b301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:22.463572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deda180-9f5d-4f85-b9fb-ac32eb51b301 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:22.463959 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deda180-9f5d-4f85-b9fb-ac32eb51b301 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:22.464933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deda180-9f5d-4f85-b9fb-ac32eb51b301 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:22.475046 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:22.477096 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deda180-9f5d-4f85-b9fb-ac32eb51b301 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:22.478594 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deda180-9f5d-4f85-b9fb-ac32eb51b301 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:22.488880 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3fb7a-cc22-4e04-aad1-14aa4dccef06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:22.489636 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3fb7a-cc22-4e04-aad1-14aa4dccef06 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:22.490017 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3fb7a-cc22-4e04-aad1-14aa4dccef06 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:22.490392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3fb7a-cc22-4e04-aad1-14aa4dccef06 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:22.491190 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3fb7a-cc22-4e04-aad1-14aa4dccef06 None admin] RBAC: Adding query filter params (name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:22.491594 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3fb7a-cc22-4e04-aad1-14aa4dccef06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:22.493194 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3fb7a-cc22-4e04-aad1-14aa4dccef06 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-8deda180-9f5d-4f85-b9fb-ac32eb51b301 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:22.494626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:22.495825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:22.496987 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:22.496987 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:22.496987 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:22.496987 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 294/612] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:22.497983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deda180-9f5d-4f85-b9fb-ac32eb51b301 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:22.508751 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 319/613] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:14:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:22.509897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3fb7a-cc22-4e04-aad1-14aa4dccef06 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:22.562724 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:22.624377 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deda180-9f5d-4f85-b9fb-ac32eb51b301 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:22.627140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3fb7a-cc22-4e04-aad1-14aa4dccef06 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:22.661539 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54961b93-654d-4a0c-9625-65a9b960ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:22.662149 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54961b93-654d-4a0c-9625-65a9b960ef2e None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:22.662430 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54961b93-654d-4a0c-9625-65a9b960ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:22.662698 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54961b93-654d-4a0c-9625-65a9b960ef2e None admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:22.663425 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54961b93-654d-4a0c-9625-65a9b960ef2e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:22.663731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54961b93-654d-4a0c-9625-65a9b960ef2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:22.664954 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d43f79-a775-4989-9af5-9e1a1f92290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:22.665196 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54961b93-654d-4a0c-9625-65a9b960ef2e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:22.665615 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d43f79-a775-4989-9af5-9e1a1f92290b None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:22.665898 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d43f79-a775-4989-9af5-9e1a1f92290b None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:22.666170 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d43f79-a775-4989-9af5-9e1a1f92290b None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:22.666928 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d43f79-a775-4989-9af5-9e1a1f92290b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:22.667837 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d43f79-a775-4989-9af5-9e1a1f92290b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:22.669432 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d43f79-a775-4989-9af5-9e1a1f92290b None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:22.686061 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 320/614] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:22.686925 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d43f79-a775-4989-9af5-9e1a1f92290b None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:22.687620 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 295/615] 10.222.0.43 () {56 vars in 1137 bytes} [Sat Sep 3 21:14:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:22.691447 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54961b93-654d-4a0c-9625-65a9b960ef2e None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:22.741040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:22.801414 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d43f79-a775-4989-9af5-9e1a1f92290b None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:22.807059 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54961b93-654d-4a0c-9625-65a9b960ef2e None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:22.809058 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:22.842589 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395ba01-e610-40e6-ad0d-ac2640b1ec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:22.843226 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395ba01-e610-40e6-ad0d-ac2640b1ec6b None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:22.843509 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395ba01-e610-40e6-ad0d-ac2640b1ec6b None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:22.843787 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395ba01-e610-40e6-ad0d-ac2640b1ec6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:22.844777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0a5df-a635-47b0-a9c5-fdd2cf50316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:22.845411 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0a5df-a635-47b0-a9c5-fdd2cf50316f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:22.845973 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0a5df-a635-47b0-a9c5-fdd2cf50316f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:22.846256 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0a5df-a635-47b0-a9c5-fdd2cf50316f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:22.855660 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0a5df-a635-47b0-a9c5-fdd2cf50316f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:22.855868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395ba01-e610-40e6-ad0d-ac2640b1ec6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:22.857204 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0a5df-a635-47b0-a9c5-fdd2cf50316f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:22.857312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395ba01-e610-40e6-ad0d-ac2640b1ec6b None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-e1a0a5df-a635-47b0-a9c5-fdd2cf50316f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:22.870833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:22.871836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:22.872845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:22.872845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:22.872845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:22.872845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:22.872845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:22.872845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:22.872845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:22.872845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:22.872845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 21:14:22.872845 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-f395ba01-e610-40e6-ad0d-ac2640b1ec6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:22.874060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:22.874912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:22.875810 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:22.875810 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:22.875810 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:22.876849 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 296/616] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:14:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:22.877343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 321/617] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:22.877544 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0a5df-a635-47b0-a9c5-fdd2cf50316f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:22.878683 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395ba01-e610-40e6-ad0d-ac2640b1ec6b None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:22.988736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:22.996898 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395ba01-e610-40e6-ad0d-ac2640b1ec6b None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:22.998385 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0a5df-a635-47b0-a9c5-fdd2cf50316f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:23.038354 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba71391-f9bc-421b-bbbd-3af654b0303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:23.039078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba71391-f9bc-421b-bbbd-3af654b0303f None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:23.039364 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba71391-f9bc-421b-bbbd-3af654b0303f None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:23.039637 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba71391-f9bc-421b-bbbd-3af654b0303f None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:23.040368 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba71391-f9bc-421b-bbbd-3af654b0303f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:23.040713 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba71391-f9bc-421b-bbbd-3af654b0303f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:23.042235 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba71391-f9bc-421b-bbbd-3af654b0303f None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:23.046368 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fd11b-e302-4134-b751-5a55716a67fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:23.046647 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd11b-e302-4134-b751-5a55716a67fd None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:23.046998 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd11b-e302-4134-b751-5a55716a67fd None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:23.047341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fd11b-e302-4134-b751-5a55716a67fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:23.067685 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 322/618] 10.222.0.43 () {56 vars in 1137 bytes} [Sat Sep 3 21:14:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:23.067685 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba71391-f9bc-421b-bbbd-3af654b0303f None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:23.092497 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:23.140912 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fd11b-e302-4134-b751-5a55716a67fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:23.142418 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fd11b-e302-4134-b751-5a55716a67fd None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:23.193661 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba71391-f9bc-421b-bbbd-3af654b0303f None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:23.235661 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b89674-f0e1-46c7-a736-c52d708c8e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:23.236274 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b89674-f0e1-46c7-a736-c52d708c8e1b None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:23.236604 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b89674-f0e1-46c7-a736-c52d708c8e1b None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:23.236858 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b89674-f0e1-46c7-a736-c52d708c8e1b None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:23.237519 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b89674-f0e1-46c7-a736-c52d708c8e1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:23.237824 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b89674-f0e1-46c7-a736-c52d708c8e1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:23.239235 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b89674-f0e1-46c7-a736-c52d708c8e1b None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:23.251978 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 323/619] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:23.252810 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b89674-f0e1-46c7-a736-c52d708c8e1b None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:23.271678 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 297/620] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:23.272915 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fd11b-e302-4134-b751-5a55716a67fd None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:23.278837 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:23.347875 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:23.375013 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b89674-f0e1-46c7-a736-c52d708c8e1b None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:23.392303 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fd11b-e302-4134-b751-5a55716a67fd None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:23.419476 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d76d0-11d3-4f68-aa2f-2701ae42a1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:23.420092 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d76d0-11d3-4f68-aa2f-2701ae42a1a7 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:23.420372 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d76d0-11d3-4f68-aa2f-2701ae42a1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:23.420680 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d76d0-11d3-4f68-aa2f-2701ae42a1a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:23.436251 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432d3ce-734b-4b06-8f36-020e9201b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:23.436862 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432d3ce-734b-4b06-8f36-020e9201b11c None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:23.437072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432d3ce-734b-4b06-8f36-020e9201b11c None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:23.437340 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432d3ce-734b-4b06-8f36-020e9201b11c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:23.449963 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432d3ce-734b-4b06-8f36-020e9201b11c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:23.451437 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432d3ce-734b-4b06-8f36-020e9201b11c None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-0432d3ce-734b-4b06-8f36-020e9201b11c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:23.466628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:23.467672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:23.474874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:23.474874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:23.474874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:23.474874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:23.474874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:23.474874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:23.474874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:23.474874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:23.474874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 03 21:14:23.474874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:23.474874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 298/621] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:14:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:23.474874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432d3ce-734b-4b06-8f36-020e9201b11c None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:23.511401 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d76d0-11d3-4f68-aa2f-2701ae42a1a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:23.512894 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d76d0-11d3-4f68-aa2f-2701ae42a1a7 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:23.529696 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:23.594151 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432d3ce-734b-4b06-8f36-020e9201b11c None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:23.618472 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:23.625453 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 324/622] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:23.626312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d76d0-11d3-4f68-aa2f-2701ae42a1a7 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:23.636127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54800c95-8e04-429d-9588-37dc0e4090f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:23.637121 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54800c95-8e04-429d-9588-37dc0e4090f5 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:23.637400 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54800c95-8e04-429d-9588-37dc0e4090f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:23.637676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54800c95-8e04-429d-9588-37dc0e4090f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:23.649370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54800c95-8e04-429d-9588-37dc0e4090f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:23.650839 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54800c95-8e04-429d-9588-37dc0e4090f5 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-54800c95-8e04-429d-9588-37dc0e4090f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:23.669512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:23.670604 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:23.671511 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:23.671511 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:23.671511 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:23.671511 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 299/623] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:23.671511 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54800c95-8e04-429d-9588-37dc0e4090f5 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:23.749304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d76d0-11d3-4f68-aa2f-2701ae42a1a7 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:23.765936 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:23.789645 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c81b04-3e24-4a8f-bd04-d49c29ce7b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:23.790394 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c81b04-3e24-4a8f-bd04-d49c29ce7b73 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:23.790677 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c81b04-3e24-4a8f-bd04-d49c29ce7b73 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:23.790950 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c81b04-3e24-4a8f-bd04-d49c29ce7b73 None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:23.791680 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c81b04-3e24-4a8f-bd04-d49c29ce7b73 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:23.791986 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c81b04-3e24-4a8f-bd04-d49c29ce7b73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:23.792774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54800c95-8e04-429d-9588-37dc0e4090f5 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:23.794362 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c81b04-3e24-4a8f-bd04-d49c29ce7b73 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:23.813594 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 325/624] 10.222.0.43 () {56 vars in 1139 bytes} [Sat Sep 3 21:14:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:23.814850 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c81b04-3e24-4a8f-bd04-d49c29ce7b73 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:23.839781 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfcb5c-f292-4fc1-97af-a304beb0942f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:23.840507 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfcb5c-f292-4fc1-97af-a304beb0942f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:23.840824 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfcb5c-f292-4fc1-97af-a304beb0942f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:23.841102 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfcb5c-f292-4fc1-97af-a304beb0942f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:23.852252 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfcb5c-f292-4fc1-97af-a304beb0942f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:23.854038 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfcb5c-f292-4fc1-97af-a304beb0942f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-0fcfcb5c-f292-4fc1-97af-a304beb0942f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:23.870112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:23.872236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:23.873208 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:23.873208 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:23.873208 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:23.873208 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 300/625] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:23.873208 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfcb5c-f292-4fc1-97af-a304beb0942f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:23.908398 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:23.936793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c81b04-3e24-4a8f-bd04-d49c29ce7b73 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:23.973464 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3214112-214c-4bd4-bb0c-aa35b86468d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:23.974176 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214112-214c-4bd4-bb0c-aa35b86468d0 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:23.974534 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214112-214c-4bd4-bb0c-aa35b86468d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:23.974811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214112-214c-4bd4-bb0c-aa35b86468d0 None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:23.975449 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3214112-214c-4bd4-bb0c-aa35b86468d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:23.975754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3214112-214c-4bd4-bb0c-aa35b86468d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:23.977171 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3214112-214c-4bd4-bb0c-aa35b86468d0 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:23.988483 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfcb5c-f292-4fc1-97af-a304beb0942f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:23.989835 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 326/626] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:23.990660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3214112-214c-4bd4-bb0c-aa35b86468d0 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:24.032409 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:24.040645 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb6717-167a-4f50-bf08-5debef1a7b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:24.041254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb6717-167a-4f50-bf08-5debef1a7b8b None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:24.041534 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb6717-167a-4f50-bf08-5debef1a7b8b None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:24.041809 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb6717-167a-4f50-bf08-5debef1a7b8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:24.119639 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3214112-214c-4bd4-bb0c-aa35b86468d0 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:24.145270 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb6717-167a-4f50-bf08-5debef1a7b8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:24.147076 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb6717-167a-4f50-bf08-5debef1a7b8b None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:24.165103 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012eca5-7e3d-4455-8c5a-82c7846efa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:24.166240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012eca5-7e3d-4455-8c5a-82c7846efa52 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:24.166240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012eca5-7e3d-4455-8c5a-82c7846efa52 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:24.166623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012eca5-7e3d-4455-8c5a-82c7846efa52 None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:24.167387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012eca5-7e3d-4455-8c5a-82c7846efa52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:24.167753 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012eca5-7e3d-4455-8c5a-82c7846efa52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:24.169247 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012eca5-7e3d-4455-8c5a-82c7846efa52 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:24.179632 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:24.183474 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 327/627] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:24.188932 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012eca5-7e3d-4455-8c5a-82c7846efa52 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:24.264689 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 301/628] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:24.265553 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb6717-167a-4f50-bf08-5debef1a7b8b None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:24.299287 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:24.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012eca5-7e3d-4455-8c5a-82c7846efa52 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:24.344189 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc64697-1a58-4ec7-917b-56162f99a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:24.344860 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc64697-1a58-4ec7-917b-56162f99a3d9 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:24.345178 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc64697-1a58-4ec7-917b-56162f99a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:24.345451 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc64697-1a58-4ec7-917b-56162f99a3d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:24.352457 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc64697-1a58-4ec7-917b-56162f99a3d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:24.354882 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc64697-1a58-4ec7-917b-56162f99a3d9 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-0cc64697-1a58-4ec7-917b-56162f99a3d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:24.366452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:24.367612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:24.369012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:24.369012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:24.369012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:24.369012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:24.369012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:24.369012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:24.369012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:24.369012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:24.369012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 328/629] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:24.369012 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc64697-1a58-4ec7-917b-56162f99a3d9 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:24.379000 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb6717-167a-4f50-bf08-5debef1a7b8b None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:24.406685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:24.415290 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5a1fc-2dd7-4753-a5ae-f0dd35f989a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:24.415924 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5a1fc-2dd7-4753-a5ae-f0dd35f989a0 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:24.416203 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5a1fc-2dd7-4753-a5ae-f0dd35f989a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:24.416474 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5a1fc-2dd7-4753-a5ae-f0dd35f989a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:24.423925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5a1fc-2dd7-4753-a5ae-f0dd35f989a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:24.425419 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5a1fc-2dd7-4753-a5ae-f0dd35f989a0 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-0bc5a1fc-2dd7-4753-a5ae-f0dd35f989a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:24.437811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:24.439650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:24.441395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:24.441395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:24.441395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:24.441395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:24.441395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:24.441395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:24.441395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:24.441395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:24.441395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 302/630] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:24.441395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3892-bb32-4786-a828-9ee0baa5a102 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:24.441395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3892-bb32-4786-a828-9ee0baa5a102 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:24.442026 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3892-bb32-4786-a828-9ee0baa5a102 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:24.442026 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 303/631] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:24.442915 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace3892-bb32-4786-a828-9ee0baa5a102 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:24.483190 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc64697-1a58-4ec7-917b-56162f99a3d9 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:24.519444 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c7cb-8cea-44ab-8086-418992637827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:24.520133 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c7cb-8cea-44ab-8086-418992637827 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:24.520334 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c7cb-8cea-44ab-8086-418992637827 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:24.520666 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c7cb-8cea-44ab-8086-418992637827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:24.531868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2c7cb-8cea-44ab-8086-418992637827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:24.533380 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2c7cb-8cea-44ab-8086-418992637827 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-7eb2c7cb-8cea-44ab-8086-418992637827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:24.548816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:24.549980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:24.550917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:24.550917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:24.550917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:24.550917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 329/632] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:24.550917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c7cb-8cea-44ab-8086-418992637827 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:24.557224 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:24.559162 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace3892-bb32-4786-a828-9ee0baa5a102 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:24.594701 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03eaa4-eb12-4c76-af8a-b995454bf44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:24.595330 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03eaa4-eb12-4c76-af8a-b995454bf44a None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:24.595614 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03eaa4-eb12-4c76-af8a-b995454bf44a None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:24.595891 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03eaa4-eb12-4c76-af8a-b995454bf44a None admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:24.596633 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03eaa4-eb12-4c76-af8a-b995454bf44a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:24.597441 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03eaa4-eb12-4c76-af8a-b995454bf44a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:24.598404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03eaa4-eb12-4c76-af8a-b995454bf44a None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:24.611792 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 304/633] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:24.613073 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd281bd-3bda-4765-86cb-306320a0efbb None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:24.613322 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd281bd-3bda-4765-86cb-306320a0efbb None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:24.613597 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd281bd-3bda-4765-86cb-306320a0efbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:24.632790 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-cfd281bd-3bda-4765-86cb-306320a0efbb None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:24.633997 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-cfd281bd-3bda-4765-86cb-306320a0efbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:24.658166 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c7cb-8cea-44ab-8086-418992637827 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:24.680361 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:24.694733 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803376a-7f8f-428b-9894-c128ecf08389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:24.695341 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803376a-7f8f-428b-9894-c128ecf08389 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:24.695625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803376a-7f8f-428b-9894-c128ecf08389 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:24.695888 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803376a-7f8f-428b-9894-c128ecf08389 None admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:24.696634 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803376a-7f8f-428b-9894-c128ecf08389 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:24.696934 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803376a-7f8f-428b-9894-c128ecf08389 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:24.698383 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803376a-7f8f-428b-9894-c128ecf08389 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:24.704469 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 305/634] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:24.705365 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd281bd-3bda-4765-86cb-306320a0efbb None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:24.712763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 330/635] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:24.713540 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803376a-7f8f-428b-9894-c128ecf08389 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:24.785006 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:24.820861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd281bd-3bda-4765-86cb-306320a0efbb None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:24.825145 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803376a-7f8f-428b-9894-c128ecf08389 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:24.863065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f408f-7650-41ee-8f2d-7804b6a896dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:24.864037 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f408f-7650-41ee-8f2d-7804b6a896dd None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:24.864469 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f408f-7650-41ee-8f2d-7804b6a896dd None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:24.864941 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f408f-7650-41ee-8f2d-7804b6a896dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:24.866018 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f408f-7650-41ee-8f2d-7804b6a896dd None admin] RBAC: Adding query filter params (role.id=a591fae52df7454f9d4067c495390a2e, scope.project.id=3bae29e3189d480c9200f03128f0c607, user.id=c05e9121d1bc48d497410de13a07b198) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:24.866480 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f408f-7650-41ee-8f2d-7804b6a896dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:24.866774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7bdfb-b596-42d1-a8cc-308af60c5dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:24.867382 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7bdfb-b596-42d1-a8cc-308af60c5dff None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:24.867660 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7bdfb-b596-42d1-a8cc-308af60c5dff None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:24.867928 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7bdfb-b596-42d1-a8cc-308af60c5dff None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:24.868590 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7bdfb-b596-42d1-a8cc-308af60c5dff None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:24.868896 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7bdfb-b596-42d1-a8cc-308af60c5dff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:24.869069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f408f-7650-41ee-8f2d-7804b6a896dd None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:24.870272 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7bdfb-b596-42d1-a8cc-308af60c5dff None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:24.880555 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 331/636] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:14:24 2022] GET /identity/v3/role_assignments?user.id=c05e9121d1bc48d497410de13a07b198&scope.project.id=3bae29e3189d480c9200f03128f0c607&role.id=a591fae52df7454f9d4067c495390a2e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:24.881503 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f408f-7650-41ee-8f2d-7804b6a896dd None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:24.892746 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 306/637] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:24.899021 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7bdfb-b596-42d1-a8cc-308af60c5dff None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:24.949610 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:25.029989 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f408f-7650-41ee-8f2d-7804b6a896dd None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:25.054522 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7bdfb-b596-42d1-a8cc-308af60c5dff None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:25.070148 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:25.084566 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7aa5a-f5c5-4d61-a7ee-2419598d5a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:25.085167 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7aa5a-f5c5-4d61-a7ee-2419598d5a01 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:25.085454 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7aa5a-f5c5-4d61-a7ee-2419598d5a01 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:25.085798 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7aa5a-f5c5-4d61-a7ee-2419598d5a01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:25.086562 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7aa5a-f5c5-4d61-a7ee-2419598d5a01 None admin] RBAC: Adding query filter params (role.id=a591fae52df7454f9d4067c495390a2e, scope.project.id=3bae29e3189d480c9200f03128f0c607, user.id=90cd1e165f3c4eba95dc93a25011b695) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:25.086918 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7aa5a-f5c5-4d61-a7ee-2419598d5a01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:25.088379 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7aa5a-f5c5-4d61-a7ee-2419598d5a01 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:25.096945 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 332/638] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:14:24 2022] GET /identity/v3/role_assignments?user.id=90cd1e165f3c4eba95dc93a25011b695&scope.project.id=3bae29e3189d480c9200f03128f0c607&role.id=a591fae52df7454f9d4067c495390a2e => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:25.097621 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7aa5a-f5c5-4d61-a7ee-2419598d5a01 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:25.110164 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329f34d-c6e8-411a-bb74-d0b63ab87003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:25.111731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329f34d-c6e8-411a-bb74-d0b63ab87003 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:25.112003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329f34d-c6e8-411a-bb74-d0b63ab87003 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:25.112168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329f34d-c6e8-411a-bb74-d0b63ab87003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:25.122489 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329f34d-c6e8-411a-bb74-d0b63ab87003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:25.124998 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329f34d-c6e8-411a-bb74-d0b63ab87003 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-8329f34d-c6e8-411a-bb74-d0b63ab87003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:25.143011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:25.144006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:25.145047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:25.145047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:25.145047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:25.145047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:25.145047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:25.145047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:25.145047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:25.145047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:25.147085 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 307/639] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:25.154542 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329f34d-c6e8-411a-bb74-d0b63ab87003 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:25.275938 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7aa5a-f5c5-4d61-a7ee-2419598d5a01 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:25.295500 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:25.303931 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329f34d-c6e8-411a-bb74-d0b63ab87003 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:25.323939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02fab1-1235-4c0e-8637-a95528bc1fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:25.324952 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02fab1-1235-4c0e-8637-a95528bc1fd7 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:25.325328 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02fab1-1235-4c0e-8637-a95528bc1fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:25.325603 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02fab1-1235-4c0e-8637-a95528bc1fd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:25.340919 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02fab1-1235-4c0e-8637-a95528bc1fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-ff02fab1-1235-4c0e-8637-a95528bc1fd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:25.348442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:25.349556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:25.350467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:25.350467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:25.350467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:25.350467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:25.350467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:25.350467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:25.350467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:25.350467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:25.350467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:25.350467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:25.350467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:14:25.350467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:25.350467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 333/640] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:14:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:25.355306 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c1cb6-4157-4289-89ef-e01977aafe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:25.356796 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c1cb6-4157-4289-89ef-e01977aafe1a None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:25.357265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c1cb6-4157-4289-89ef-e01977aafe1a None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:25.357722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c1cb6-4157-4289-89ef-e01977aafe1a None admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:25.358337 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02fab1-1235-4c0e-8637-a95528bc1fd7 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:25.358932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c1cb6-4157-4289-89ef-e01977aafe1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:25.359441 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c1cb6-4157-4289-89ef-e01977aafe1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:25.362125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c1cb6-4157-4289-89ef-e01977aafe1a None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:25.387513 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 308/641] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:25.394045 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c1cb6-4157-4289-89ef-e01977aafe1a None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:25.455188 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:25.521262 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02fab1-1235-4c0e-8637-a95528bc1fd7 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:25.535770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c1cb6-4157-4289-89ef-e01977aafe1a None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:25.568787 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2593900-1479-4753-95d8-27c05607936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:25.569547 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2593900-1479-4753-95d8-27c05607936a None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:25.569927 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2593900-1479-4753-95d8-27c05607936a None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:25.570297 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2593900-1479-4753-95d8-27c05607936a None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:25.571127 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2593900-1479-4753-95d8-27c05607936a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:25.571546 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2593900-1479-4753-95d8-27c05607936a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:25.573255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2593900-1479-4753-95d8-27c05607936a None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:25.579457 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905d72b-35a7-419f-a7b6-d41b1abba581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:25.580332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905d72b-35a7-419f-a7b6-d41b1abba581 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:25.580812 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905d72b-35a7-419f-a7b6-d41b1abba581 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:25.588253 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905d72b-35a7-419f-a7b6-d41b1abba581 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:25.588253 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905d72b-35a7-419f-a7b6-d41b1abba581 None admin] RBAC: Adding query filter params (role.id=a591fae52df7454f9d4067c495390a2e, scope.project.id=3bae29e3189d480c9200f03128f0c607, user.id=a969a77183c34a7e9eff28636b1170c3) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:25.588253 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905d72b-35a7-419f-a7b6-d41b1abba581 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:25.588568 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 334/642] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:14:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:25.590031 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905d72b-35a7-419f-a7b6-d41b1abba581 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:25.594802 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2593900-1479-4753-95d8-27c05607936a None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:25.601115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 309/643] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:14:25 2022] GET /identity/v3/role_assignments?user.id=a969a77183c34a7e9eff28636b1170c3&scope.project.id=3bae29e3189d480c9200f03128f0c607&role.id=a591fae52df7454f9d4067c495390a2e => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:25.776011 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2593900-1479-4753-95d8-27c05607936a None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:25.804944 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:25.828063 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bd32c-2ea1-4170-b4f4-01d4e6d8e53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:25.828856 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd32c-2ea1-4170-b4f4-01d4e6d8e53f None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:25.829215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd32c-2ea1-4170-b4f4-01d4e6d8e53f None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:25.829550 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd32c-2ea1-4170-b4f4-01d4e6d8e53f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:25.842527 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bd32c-2ea1-4170-b4f4-01d4e6d8e53f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:25.844086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bd32c-2ea1-4170-b4f4-01d4e6d8e53f None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-ff9bd32c-2ea1-4170-b4f4-01d4e6d8e53f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:25.860732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:25.861693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:25.862589 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:25.862589 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:25.862589 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:25.863196 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 335/644] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:14:25.870444 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905d72b-35a7-419f-a7b6-d41b1abba581 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:25.896584 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:25.984724 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905d72b-35a7-419f-a7b6-d41b1abba581 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:26.024770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dd3bc-7fa6-4ff5-b179-414abf2281be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:26.025457 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dd3bc-7fa6-4ff5-b179-414abf2281be None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:26.025738 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dd3bc-7fa6-4ff5-b179-414abf2281be None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:26.026007 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dd3bc-7fa6-4ff5-b179-414abf2281be None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:26.027352 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dd3bc-7fa6-4ff5-b179-414abf2281be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:26.027763 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dd3bc-7fa6-4ff5-b179-414abf2281be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:26.029176 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2dd3bc-7fa6-4ff5-b179-414abf2281be None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:26.044821 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 310/645] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:26.048191 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bd32c-2ea1-4170-b4f4-01d4e6d8e53f None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:26.167862 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bd32c-2ea1-4170-b4f4-01d4e6d8e53f None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:26.207359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a43526-36ec-4e8e-9e01-4449005f4adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:26.207995 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a43526-36ec-4e8e-9e01-4449005f4adf None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:26.208275 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a43526-36ec-4e8e-9e01-4449005f4adf None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:26.208561 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a43526-36ec-4e8e-9e01-4449005f4adf None admin] PATH_INFO: `/v3/users/nova` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:26.218968 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a43526-36ec-4e8e-9e01-4449005f4adf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:26.221406 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a43526-36ec-4e8e-9e01-4449005f4adf None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-42a43526-36ec-4e8e-9e01-4449005f4adf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:26.239413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:26.240448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:26.241461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:26.241461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:26.241461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:26.241461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:26.241461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:26.241461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:26.241461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:26.241461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:26.241461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 21:14:26.241461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:26.246725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 336/646] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Sep 3 21:14:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:26.249662 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dd3bc-7fa6-4ff5-b179-414abf2281be None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:26.348652 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:26.368417 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dd3bc-7fa6-4ff5-b179-414abf2281be None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:26.406464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40927d75-3d71-49b7-983f-53a4e1ccf4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:26.407069 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40927d75-3d71-49b7-983f-53a4e1ccf4cc None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:26.407349 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40927d75-3d71-49b7-983f-53a4e1ccf4cc None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:26.407620 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40927d75-3d71-49b7-983f-53a4e1ccf4cc None admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:26.408345 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40927d75-3d71-49b7-983f-53a4e1ccf4cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:26.408682 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40927d75-3d71-49b7-983f-53a4e1ccf4cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:26.410115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40927d75-3d71-49b7-983f-53a4e1ccf4cc None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:26.431028 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 311/647] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Sep 3 21:14:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:26.437094 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a43526-36ec-4e8e-9e01-4449005f4adf None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:26.468646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:26.550215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a43526-36ec-4e8e-9e01-4449005f4adf None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:26.587146 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf1fc8-ff88-4843-87df-1db278324680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:26.588202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf1fc8-ff88-4843-87df-1db278324680 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:26.588713 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf1fc8-ff88-4843-87df-1db278324680 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:26.589817 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf1fc8-ff88-4843-87df-1db278324680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:26.663887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf1fc8-ff88-4843-87df-1db278324680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:26.665766 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf1fc8-ff88-4843-87df-1db278324680 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:26.695662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:26.773605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 337/648] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:14:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 03 21:14:26.781644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40927d75-3d71-49b7-983f-53a4e1ccf4cc None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:26.890515 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40927d75-3d71-49b7-983f-53a4e1ccf4cc None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:26.929565 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081b9ce-5b81-4342-8ffc-da05a9515661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:26.930674 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081b9ce-5b81-4342-8ffc-da05a9515661 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:26.931213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081b9ce-5b81-4342-8ffc-da05a9515661 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:26.931743 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081b9ce-5b81-4342-8ffc-da05a9515661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:26.939623 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:26.944684 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081b9ce-5b81-4342-8ffc-da05a9515661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:26.946433 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081b9ce-5b81-4342-8ffc-da05a9515661 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-6081b9ce-5b81-4342-8ffc-da05a9515661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:26.962625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:26.963636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:26.965242 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:26.965242 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:26.965242 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:26.967430 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 312/649] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:26.973233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf1fc8-ff88-4843-87df-1db278324680 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:27.084564 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf1fc8-ff88-4843-87df-1db278324680 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:27.111107 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:27.121124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42e8d3-4a05-4b53-b6b2-7ff3ff78a442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:27.121543 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42e8d3-4a05-4b53-b6b2-7ff3ff78a442 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:27.121909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42e8d3-4a05-4b53-b6b2-7ff3ff78a442 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:27.122398 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42e8d3-4a05-4b53-b6b2-7ff3ff78a442 None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:27.123058 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42e8d3-4a05-4b53-b6b2-7ff3ff78a442 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:27.123369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42e8d3-4a05-4b53-b6b2-7ff3ff78a442 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:27.124790 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42e8d3-4a05-4b53-b6b2-7ff3ff78a442 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:27.138221 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 338/650] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:27.143991 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081b9ce-5b81-4342-8ffc-da05a9515661 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:27.262795 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081b9ce-5b81-4342-8ffc-da05a9515661 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:27.298455 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4e9d8-cb34-4c3a-8d6c-202aadd59f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:27.299082 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4e9d8-cb34-4c3a-8d6c-202aadd59f43 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:27.299363 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4e9d8-cb34-4c3a-8d6c-202aadd59f43 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:27.299632 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4e9d8-cb34-4c3a-8d6c-202aadd59f43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:27.307052 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4e9d8-cb34-4c3a-8d6c-202aadd59f43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:27.309224 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4e9d8-cb34-4c3a-8d6c-202aadd59f43 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-32d4e9d8-cb34-4c3a-8d6c-202aadd59f43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:27.321432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:27.322373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:27.323278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:27.323278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:27.323278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:27.323278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:27.323278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:27.323278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:27.323278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:27.323278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:27.323278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 313/651] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:27.329795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42e8d3-4a05-4b53-b6b2-7ff3ff78a442 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:27.348554 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633fce5-e82f-4b37-ae4e-600e11d576a1 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:27.348860 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633fce5-e82f-4b37-ae4e-600e11d576a1 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:27.349129 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633fce5-e82f-4b37-ae4e-600e11d576a1 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:27.350759 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 314/652] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:14:27.355727 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819f1e0-17e0-4861-bc9b-c8c6828e9684 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:27.356162 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819f1e0-17e0-4861-bc9b-c8c6828e9684 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:27.356456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819f1e0-17e0-4861-bc9b-c8c6828e9684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:27.378620 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-f819f1e0-17e0-4861-bc9b-c8c6828e9684 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:27.380137 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-f819f1e0-17e0-4861-bc9b-c8c6828e9684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:27.448263 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42e8d3-4a05-4b53-b6b2-7ff3ff78a442 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:27.459279 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:27.490671 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 315/653] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:14:27.490872 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814d6e7-fd39-47c8-b4c4-d8a8ce8e5562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:27.493232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d6e7-fd39-47c8-b4c4-d8a8ce8e5562 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:27.493688 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d6e7-fd39-47c8-b4c4-d8a8ce8e5562 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:27.494032 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814d6e7-fd39-47c8-b4c4-d8a8ce8e5562 None admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:27.494849 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814d6e7-fd39-47c8-b4c4-d8a8ce8e5562 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:27.495166 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814d6e7-fd39-47c8-b4c4-d8a8ce8e5562 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:27.497025 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814d6e7-fd39-47c8-b4c4-d8a8ce8e5562 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:27.511626 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 339/654] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:27.517826 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819f1e0-17e0-4861-bc9b-c8c6828e9684 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:27.619541 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6f92-04d5-4bda-9af4-f26ed4693828 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:27.620178 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6f92-04d5-4bda-9af4-f26ed4693828 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:27.620178 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc6f92-04d5-4bda-9af4-f26ed4693828 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:27.621957 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 340/655] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:14:27.627419 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819f1e0-17e0-4861-bc9b-c8c6828e9684 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:27.628059 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517361bf-2d3a-4d36-8475-e538a64fb9a4 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:27.628342 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517361bf-2d3a-4d36-8475-e538a64fb9a4 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:27.628656 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517361bf-2d3a-4d36-8475-e538a64fb9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:27.647363 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-517361bf-2d3a-4d36-8475-e538a64fb9a4 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:27.648833 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-517361bf-2d3a-4d36-8475-e538a64fb9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:27.669713 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba584b-2298-4be5-8fc9-a83af5fef877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:27.670329 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba584b-2298-4be5-8fc9-a83af5fef877 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:27.670612 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba584b-2298-4be5-8fc9-a83af5fef877 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:27.670886 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba584b-2298-4be5-8fc9-a83af5fef877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:27.671770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba584b-2298-4be5-8fc9-a83af5fef877 None admin] RBAC: Adding query filter params (role.id=a1c22a1558c34c1d9d262bf1da31887e, scope.project.id=3bae29e3189d480c9200f03128f0c607, user.id=7d95ba5e28764ed49d1142fecb16adab) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:27.672185 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba584b-2298-4be5-8fc9-a83af5fef877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:27.673684 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba584b-2298-4be5-8fc9-a83af5fef877 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:27.680257 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 316/656] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:14:27 2022] GET /identity/v3/role_assignments?user.id=7d95ba5e28764ed49d1142fecb16adab&scope.project.id=3bae29e3189d480c9200f03128f0c607&role.id=a1c22a1558c34c1d9d262bf1da31887e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:27.701001 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:27.730875 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 341/657] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:14:27.873321 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba584b-2298-4be5-8fc9-a83af5fef877 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:27.935317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:28.013881 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba584b-2298-4be5-8fc9-a83af5fef877 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:28.049580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567f033-1abd-4e20-acca-d670d608ee78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:28.050251 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567f033-1abd-4e20-acca-d670d608ee78 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:28.050591 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567f033-1abd-4e20-acca-d670d608ee78 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:28.051046 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567f033-1abd-4e20-acca-d670d608ee78 None admin] PATH_INFO: `/v3/services/image` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:28.051853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567f033-1abd-4e20-acca-d670d608ee78 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:28.053405 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567f033-1abd-4e20-acca-d670d608ee78 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-2567f033-1abd-4e20-acca-d670d608ee78 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:28.065801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:28.066892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:28.068332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:28.068332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:28.068332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:28.068332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:28.068332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:28.068332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:28.068332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:28.068332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:28.068332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:28.068332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:28.068332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:28.068332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:28.068332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 21:14:28.068332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:28.069134 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517361bf-2d3a-4d36-8475-e538a64fb9a4 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:28.069209 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 317/658] 10.222.0.43 () {56 vars in 1105 bytes} [Sat Sep 3 21:14:27 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:28.074569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567f033-1abd-4e20-acca-d670d608ee78 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:28.227183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517361bf-2d3a-4d36-8475-e538a64fb9a4 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:28.233062 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567f033-1abd-4e20-acca-d670d608ee78 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:28.257295 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:28.273853 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec128c-3f68-45cd-9dd1-3429147b8baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:28.274491 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec128c-3f68-45cd-9dd1-3429147b8baa None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:28.274768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec128c-3f68-45cd-9dd1-3429147b8baa None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:28.275692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec128c-3f68-45cd-9dd1-3429147b8baa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:28.279159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec128c-3f68-45cd-9dd1-3429147b8baa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:28.279159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec128c-3f68-45cd-9dd1-3429147b8baa None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:28.289654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bb059-a7a5-4ba1-a1ce-4446836779c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:28.290260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bb059-a7a5-4ba1-a1ce-4446836779c6 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:28.290533 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bb059-a7a5-4ba1-a1ce-4446836779c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:28.290802 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bb059-a7a5-4ba1-a1ce-4446836779c6 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:28.291482 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bb059-a7a5-4ba1-a1ce-4446836779c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:28.291784 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bb059-a7a5-4ba1-a1ce-4446836779c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:28.293844 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bb059-a7a5-4ba1-a1ce-4446836779c6 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-3dec128c-3f68-45cd-9dd1-3429147b8baa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:28.298754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:28.299776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:28.300652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:28.300652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:28.300652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:28.300652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:28.300652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:28.300652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:28.300652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:28.300652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:28.300652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:28.300652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:28.300652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:28.300652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:28.300652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 21:14:28.300652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:28.303484 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 342/659] 10.222.0.43 () {56 vars in 1129 bytes} [Sat Sep 3 21:14:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:28.303811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 318/660] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:28.305167 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec128c-3f68-45cd-9dd1-3429147b8baa None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:28.310208 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bb059-a7a5-4ba1-a1ce-4446836779c6 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:28.369367 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:28.429497 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bb059-a7a5-4ba1-a1ce-4446836779c6 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:28.455639 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec128c-3f68-45cd-9dd1-3429147b8baa None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:28.471976 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656b29d-a90d-43db-8145-6b4ad13aa11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:28.472624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656b29d-a90d-43db-8145-6b4ad13aa11f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:28.476100 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656b29d-a90d-43db-8145-6b4ad13aa11f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:28.476100 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656b29d-a90d-43db-8145-6b4ad13aa11f None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:28.476100 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656b29d-a90d-43db-8145-6b4ad13aa11f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:28.476100 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656b29d-a90d-43db-8145-6b4ad13aa11f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:28.476100 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656b29d-a90d-43db-8145-6b4ad13aa11f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:28.485828 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 319/661] 10.222.0.43 () {56 vars in 1124 bytes} [Sat Sep 3 21:14:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:28.485828 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05bf36-0d1f-4144-be02-e2fb8d477acb None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:28.485828 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05bf36-0d1f-4144-be02-e2fb8d477acb None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:28.485828 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05bf36-0d1f-4144-be02-e2fb8d477acb None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:28.485828 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 320/662] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:28.489591 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05bf36-0d1f-4144-be02-e2fb8d477acb None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:28.508030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24dc0f-6dc5-43b1-8725-a3479d2f09b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:28.508686 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24dc0f-6dc5-43b1-8725-a3479d2f09b7 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:28.508964 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24dc0f-6dc5-43b1-8725-a3479d2f09b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:28.509315 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24dc0f-6dc5-43b1-8725-a3479d2f09b7 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:28.510084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24dc0f-6dc5-43b1-8725-a3479d2f09b7 None admin] RBAC: Adding query filter params (type=image) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:28.510396 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24dc0f-6dc5-43b1-8725-a3479d2f09b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:28.512236 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24dc0f-6dc5-43b1-8725-a3479d2f09b7 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:28.524868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 343/663] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:28 2022] GET /identity/v3/services?type=image => generated 122 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:28.526981 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b6266-4f8c-477d-a105-0580ed53c85f None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:28.527363 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b6266-4f8c-477d-a105-0580ed53c85f None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:28.528098 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b6266-4f8c-477d-a105-0580ed53c85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:28.553973 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-a76b6266-4f8c-477d-a105-0580ed53c85f None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:28.555708 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-a76b6266-4f8c-477d-a105-0580ed53c85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:28.556921 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:28.649637 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05bf36-0d1f-4144-be02-e2fb8d477acb None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:28.657293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 344/664] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:28.694478 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52314a88-3f88-4012-9fb1-6b0d715b82df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:28.695114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52314a88-3f88-4012-9fb1-6b0d715b82df None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:28.695396 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52314a88-3f88-4012-9fb1-6b0d715b82df None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:28.695669 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52314a88-3f88-4012-9fb1-6b0d715b82df None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:28.696311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52314a88-3f88-4012-9fb1-6b0d715b82df None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:28.696654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52314a88-3f88-4012-9fb1-6b0d715b82df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:28.698067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52314a88-3f88-4012-9fb1-6b0d715b82df None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:28.705836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 321/665] 10.222.0.43 () {56 vars in 1124 bytes} [Sat Sep 3 21:14:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:29.036982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b6266-4f8c-477d-a105-0580ed53c85f None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:29.094137 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:29.191473 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b6266-4f8c-477d-a105-0580ed53c85f None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:29.230522 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91e2ce-73bd-46d8-b90f-a800a411fb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:29.231736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91e2ce-73bd-46d8-b90f-a800a411fb89 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:29.232206 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91e2ce-73bd-46d8-b90f-a800a411fb89 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:29.232774 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91e2ce-73bd-46d8-b90f-a800a411fb89 None admin] PATH_INFO: `/v3/services/network` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:29.233563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91e2ce-73bd-46d8-b90f-a800a411fb89 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:29.235131 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91e2ce-73bd-46d8-b90f-a800a411fb89 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-6a91e2ce-73bd-46d8-b90f-a800a411fb89 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:29.245468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:29.247393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:29.248225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:29.248225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:29.248225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:29.248225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:29.248225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:29.248225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:29.248225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:29.248225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:29.248225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:29.248225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:29.248225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:29.248225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:29.248225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 21:14:29.248225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:29.250796 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 345/666] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:29 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:29.258154 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52314a88-3f88-4012-9fb1-6b0d715b82df None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:29.399342 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:29.404466 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52314a88-3f88-4012-9fb1-6b0d715b82df None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:29.443027 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517c57d-2002-4718-89d9-7888eec56794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:29.443935 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517c57d-2002-4718-89d9-7888eec56794 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:29.444368 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517c57d-2002-4718-89d9-7888eec56794 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:29.444824 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517c57d-2002-4718-89d9-7888eec56794 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:29.445612 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517c57d-2002-4718-89d9-7888eec56794 None admin] RBAC: Adding query filter params (name=network) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:29.446066 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517c57d-2002-4718-89d9-7888eec56794 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:29.447703 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517c57d-2002-4718-89d9-7888eec56794 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:29.453675 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 322/667] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Sep 3 21:14:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:29.462587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91e2ce-73bd-46d8-b90f-a800a411fb89 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:29.589588 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:29.594406 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91e2ce-73bd-46d8-b90f-a800a411fb89 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:29.632460 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b41727-3f2e-47a9-a96c-7a292af32fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:29.633387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b41727-3f2e-47a9-a96c-7a292af32fa4 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:29.633817 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b41727-3f2e-47a9-a96c-7a292af32fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:29.634238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b41727-3f2e-47a9-a96c-7a292af32fa4 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:29.635077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b41727-3f2e-47a9-a96c-7a292af32fa4 None admin] RBAC: Adding query filter params (type=network) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:29.635547 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b41727-3f2e-47a9-a96c-7a292af32fa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:29.638169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b41727-3f2e-47a9-a96c-7a292af32fa4 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:29.643951 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 346/668] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Sep 3 21:14:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:30.333292 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad307d-f439-4cab-a762-1b1dd95d95a1 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:30.333793 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad307d-f439-4cab-a762-1b1dd95d95a1 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:30.334126 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad307d-f439-4cab-a762-1b1dd95d95a1 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:30.336909 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 323/669] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:30.346357 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969bd27-c12c-4af8-bbcb-5732412d36b0 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:30.346867 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969bd27-c12c-4af8-bbcb-5732412d36b0 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:30.347291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969bd27-c12c-4af8-bbcb-5732412d36b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:30.378359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-f969bd27-c12c-4af8-bbcb-5732412d36b0 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:30.380345 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-f969bd27-c12c-4af8-bbcb-5732412d36b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:30.506498 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 347/670] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:31.134658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad307d-f439-4cab-a762-1b1dd95d95a1 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:31.144366 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa0e4-ea2e-479a-bf55-af2535a062ff None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:31.148986 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa0e4-ea2e-479a-bf55-af2535a062ff None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:31.152724 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffa0e4-ea2e-479a-bf55-af2535a062ff None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:31.153498 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 348/671] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:31 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:31.166093 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832fc88-127c-464c-980f-a36641e4e458 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:31.166590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832fc88-127c-464c-980f-a36641e4e458 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:31.167068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832fc88-127c-464c-980f-a36641e4e458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:31.200128 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-5832fc88-127c-464c-980f-a36641e4e458 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:31.202323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-5832fc88-127c-464c-980f-a36641e4e458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:31.291158 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad307d-f439-4cab-a762-1b1dd95d95a1 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:31.332574 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 349/672] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:31.334048 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbf243-0b81-4b57-9ac1-5646724b8283 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:31.334691 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbf243-0b81-4b57-9ac1-5646724b8283 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:31.335231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbf243-0b81-4b57-9ac1-5646724b8283 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:31.337955 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 350/673] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:31.345376 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131e041-c2b6-48f3-9ec3-19e55e6b52ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:31.346709 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131e041-c2b6-48f3-9ec3-19e55e6b52ff None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:31.347215 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131e041-c2b6-48f3-9ec3-19e55e6b52ff None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:31.347498 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082bb72-c93c-40bd-92f3-ccdd0827e4c2 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:31.347995 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082bb72-c93c-40bd-92f3-ccdd0827e4c2 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:31.348380 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131e041-c2b6-48f3-9ec3-19e55e6b52ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:31.348542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082bb72-c93c-40bd-92f3-ccdd0827e4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:31.366037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1131e041-c2b6-48f3-9ec3-19e55e6b52ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-1131e041-c2b6-48f3-9ec3-19e55e6b52ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:31.373962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:31.374992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:31.375840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:31.375840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:31.375840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:31.375840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:31.375840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:31.375840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:31.375840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:31.375840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:31.375840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:31.375840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:31.375840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:14:31.375840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:31.383697 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 324/674] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:14:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:31.383906 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-9082bb72-c93c-40bd-92f3-ccdd0827e4c2 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:31.383906 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-9082bb72-c93c-40bd-92f3-ccdd0827e4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:31.386076 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131e041-c2b6-48f3-9ec3-19e55e6b52ff None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:31.409584 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:31.454496 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:31.483739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 351/675] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 03 21:14:31.547559 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131e041-c2b6-48f3-9ec3-19e55e6b52ff None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:31.584974 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709c719-ace9-4bd4-a00f-614e8a18667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:31.585592 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709c719-ace9-4bd4-a00f-614e8a18667e None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:31.585877 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709c719-ace9-4bd4-a00f-614e8a18667e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:31.586152 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709c719-ace9-4bd4-a00f-614e8a18667e None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:31.587014 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709c719-ace9-4bd4-a00f-614e8a18667e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:31.587329 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709c719-ace9-4bd4-a00f-614e8a18667e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:31.588752 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709c719-ace9-4bd4-a00f-614e8a18667e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:31.599256 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 325/676] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:14:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:31.605936 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082bb72-c93c-40bd-92f3-ccdd0827e4c2 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:31.726230 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082bb72-c93c-40bd-92f3-ccdd0827e4c2 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:31.742892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709c719-ace9-4bd4-a00f-614e8a18667e None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:31.772211 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5bba4-4487-4fe2-aa56-d87740ce6cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:31.773782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5bba4-4487-4fe2-aa56-d87740ce6cb9 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:31.774423 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5bba4-4487-4fe2-aa56-d87740ce6cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:31.774982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d5bba4-4487-4fe2-aa56-d87740ce6cb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:31.789605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5bba4-4487-4fe2-aa56-d87740ce6cb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:31.791617 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d5bba4-4487-4fe2-aa56-d87740ce6cb9 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-13d5bba4-4487-4fe2-aa56-d87740ce6cb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:31.811353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:31.812333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:31.813293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:31.813293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:31.813293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:31.815688 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 352/677] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:31.821779 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5bba4-4487-4fe2-aa56-d87740ce6cb9 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:31.826997 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:31.850012 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:31.872753 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709c719-ace9-4bd4-a00f-614e8a18667e None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:31.917174 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067002de-1cdd-4381-8389-724eda872c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:31.918326 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067002de-1cdd-4381-8389-724eda872c6a None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:31.919001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067002de-1cdd-4381-8389-724eda872c6a None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:31.919001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067002de-1cdd-4381-8389-724eda872c6a None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:31.919660 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067002de-1cdd-4381-8389-724eda872c6a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:31.921153 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067002de-1cdd-4381-8389-724eda872c6a None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:31.948437 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d5bba4-4487-4fe2-aa56-d87740ce6cb9 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:31.988934 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3a798-071c-4816-bdfd-26590e7239fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:31.989596 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3a798-071c-4816-bdfd-26590e7239fd None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:31.989876 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3a798-071c-4816-bdfd-26590e7239fd None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:31.990146 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3a798-071c-4816-bdfd-26590e7239fd None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:31.990838 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3a798-071c-4816-bdfd-26590e7239fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:31.991139 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3a798-071c-4816-bdfd-26590e7239fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:31.992519 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3a798-071c-4816-bdfd-26590e7239fd None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:32.006002 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 353/678] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:32.006878 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3a798-071c-4816-bdfd-26590e7239fd None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:32.078015 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:32.108672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 326/679] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Sep 3 21:14:31 2022] POST /identity/v3/services => generated 242 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:14:32.108672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067002de-1cdd-4381-8389-724eda872c6a None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:32.138356 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3a798-071c-4816-bdfd-26590e7239fd None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:32.216975 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab9579-d50c-409f-8638-60114d3058de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:32.217623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab9579-d50c-409f-8638-60114d3058de None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:32.217911 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab9579-d50c-409f-8638-60114d3058de None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:32.218191 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab9579-d50c-409f-8638-60114d3058de None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:32.218879 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab9579-d50c-409f-8638-60114d3058de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:32.220583 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab9579-d50c-409f-8638-60114d3058de None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:32.257436 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067002de-1cdd-4381-8389-724eda872c6a None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:32.304629 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a830a72-9643-475c-9ff8-dd5338259e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:32.305283 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830a72-9643-475c-9ff8-dd5338259e94 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:32.305578 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830a72-9643-475c-9ff8-dd5338259e94 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:32.305934 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a830a72-9643-475c-9ff8-dd5338259e94 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:32.316138 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a830a72-9643-475c-9ff8-dd5338259e94 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:32.317834 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a830a72-9643-475c-9ff8-dd5338259e94 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-2a830a72-9643-475c-9ff8-dd5338259e94 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:32.331691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:32.332867 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:32.333872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:32.333872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:32.333872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:32.333872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:32.333872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:32.333872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:32.333872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:32.333872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:32.333872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 21:14:32.333872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:32.333872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 327/680] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Sep 3 21:14:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:32.338526 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a830a72-9643-475c-9ff8-dd5338259e94 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:32.342545 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 354/681] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Sep 3 21:14:32 2022] POST /identity/v3/services => generated 251 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:14:32.351141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:32.384650 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4f4f5-58e7-4093-9b77-2089d10ca6c5 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:32.385164 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4f4f5-58e7-4093-9b77-2089d10ca6c5 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:32.385164 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4f4f5-58e7-4093-9b77-2089d10ca6c5 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:32.386804 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 355/682] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:32.392836 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ede34-9322-48d0-83da-67a1caf6e3d3 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:32.393142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ede34-9322-48d0-83da-67a1caf6e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:32.393392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ede34-9322-48d0-83da-67a1caf6e3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:32.420941 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-cc1ede34-9322-48d0-83da-67a1caf6e3d3 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:32.423596 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-cc1ede34-9322-48d0-83da-67a1caf6e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:32.492992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a830a72-9643-475c-9ff8-dd5338259e94 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:32.556582 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 356/683] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:32 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 03 21:14:32.566156 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31830bda-3e2a-4070-9fe1-c652105ea5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:32.566794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31830bda-3e2a-4070-9fe1-c652105ea5cc None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:32.567067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31830bda-3e2a-4070-9fe1-c652105ea5cc None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:32.567338 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31830bda-3e2a-4070-9fe1-c652105ea5cc None admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:32.568091 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31830bda-3e2a-4070-9fe1-c652105ea5cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:32.568400 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31830bda-3e2a-4070-9fe1-c652105ea5cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:32.569927 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31830bda-3e2a-4070-9fe1-c652105ea5cc None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:32.592961 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 328/684] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Sep 3 21:14:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:32.598113 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ede34-9322-48d0-83da-67a1caf6e3d3 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:32.654051 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:32.713422 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ede34-9322-48d0-83da-67a1caf6e3d3 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:32.774508 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c99eee-9496-49ea-846b-b841ed85c3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:32.775687 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99eee-9496-49ea-846b-b841ed85c3e8 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:32.776157 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99eee-9496-49ea-846b-b841ed85c3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:32.776676 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c99eee-9496-49ea-846b-b841ed85c3e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:32.796446 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c99eee-9496-49ea-846b-b841ed85c3e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:32.799173 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c99eee-9496-49ea-846b-b841ed85c3e8 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-21c99eee-9496-49ea-846b-b841ed85c3e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:32.827679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:32.828736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:32.829658 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:32.829658 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:32.829658 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:32.830321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 357/685] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:32.835479 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31830bda-3e2a-4070-9fe1-c652105ea5cc None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:32.909701 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:32.957307 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31830bda-3e2a-4070-9fe1-c652105ea5cc None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:32.985881 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c99eee-9496-49ea-846b-b841ed85c3e8 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:32.998912 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148108f8-12b0-48ad-84f5-44bda100f043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:32.999822 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148108f8-12b0-48ad-84f5-44bda100f043 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:33.000281 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148108f8-12b0-48ad-84f5-44bda100f043 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:33.000741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148108f8-12b0-48ad-84f5-44bda100f043 None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:33.001562 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148108f8-12b0-48ad-84f5-44bda100f043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:33.002021 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148108f8-12b0-48ad-84f5-44bda100f043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:33.003576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148108f8-12b0-48ad-84f5-44bda100f043 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:33.021745 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 329/686] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:33.024044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148108f8-12b0-48ad-84f5-44bda100f043 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:33.103530 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:33.111854 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c99eee-9496-49ea-846b-b841ed85c3e8 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:33.169277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148108f8-12b0-48ad-84f5-44bda100f043 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:33.183952 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff47e8a-9bfb-42c4-8e41-9880aba640eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:33.185680 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff47e8a-9bfb-42c4-8e41-9880aba640eb None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:33.185962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff47e8a-9bfb-42c4-8e41-9880aba640eb None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:33.186242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff47e8a-9bfb-42c4-8e41-9880aba640eb None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:33.186913 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff47e8a-9bfb-42c4-8e41-9880aba640eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:33.188327 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff47e8a-9bfb-42c4-8e41-9880aba640eb None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:33.216413 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:33.228930 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fded1a-4609-4b31-b23c-75c7351774e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:33.229660 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fded1a-4609-4b31-b23c-75c7351774e9 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:33.230046 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fded1a-4609-4b31-b23c-75c7351774e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:33.230801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fded1a-4609-4b31-b23c-75c7351774e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:33.238781 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fded1a-4609-4b31-b23c-75c7351774e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:33.240247 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fded1a-4609-4b31-b23c-75c7351774e9 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-e4fded1a-4609-4b31-b23c-75c7351774e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:33.252731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:33.258435 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:33.266611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:33.266611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:33.266611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:33.266611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:33.266611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:33.266611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:33.266611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:33.266611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:33.266611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 330/687] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:33.266611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fded1a-4609-4b31-b23c-75c7351774e9 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:33.279769 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 358/688] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Sep 3 21:14:32 2022] POST /identity/v3/services => generated 240 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 21:14:33.423841 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fded1a-4609-4b31-b23c-75c7351774e9 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:33.477280 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477b9d4-03f6-4bc7-9dc1-12b4d1490ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:33.478328 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477b9d4-03f6-4bc7-9dc1-12b4d1490ee9 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:33.478823 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477b9d4-03f6-4bc7-9dc1-12b4d1490ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:33.479308 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477b9d4-03f6-4bc7-9dc1-12b4d1490ee9 None admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:33.480888 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477b9d4-03f6-4bc7-9dc1-12b4d1490ee9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:33.481462 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477b9d4-03f6-4bc7-9dc1-12b4d1490ee9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:33.483448 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477b9d4-03f6-4bc7-9dc1-12b4d1490ee9 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:33.499683 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 331/689] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:33.505450 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff47e8a-9bfb-42c4-8e41-9880aba640eb None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:33.642198 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff47e8a-9bfb-42c4-8e41-9880aba640eb None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:33.679525 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6aa02-2a6b-4aef-a04d-1f42dc4ad87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:33.680109 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6aa02-2a6b-4aef-a04d-1f42dc4ad87c None admin] REQUEST_METHOD: `PUT` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:33.680391 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6aa02-2a6b-4aef-a04d-1f42dc4ad87c None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:33.680700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6aa02-2a6b-4aef-a04d-1f42dc4ad87c None admin] PATH_INFO: `/v3/projects/3bae29e3189d480c9200f03128f0c607/users/7d95ba5e28764ed49d1142fecb16adab/roles/a1c22a1558c34c1d9d262bf1da31887e` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:33.682642 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6aa02-2a6b-4aef-a04d-1f42dc4ad87c None admin] RBAC: Authorizing `identity:create_grant(project_id=3bae29e3189d480c9200f03128f0c607, user_id=7d95ba5e28764ed49d1142fecb16adab, role_id=a1c22a1558c34c1d9d262bf1da31887e)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:33.684423 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6aa02-2a6b-4aef-a04d-1f42dc4ad87c None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:33.759673 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 359/690] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:14:33 2022] PUT /identity/v3/projects/3bae29e3189d480c9200f03128f0c607/users/7d95ba5e28764ed49d1142fecb16adab/roles/a1c22a1558c34c1d9d262bf1da31887e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:14:34.681634 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf1248-a583-4333-b658-a89503b506d6 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:34.682155 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf1248-a583-4333-b658-a89503b506d6 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:34.682155 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf1248-a583-4333-b658-a89503b506d6 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:34.684350 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 332/691] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:34.690008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f42fa-9b1e-4cea-a02b-ea5308380b49 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:34.690435 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f42fa-9b1e-4cea-a02b-ea5308380b49 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:34.690612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f42fa-9b1e-4cea-a02b-ea5308380b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:34.709033 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-667f42fa-9b1e-4cea-a02b-ea5308380b49 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:34.710210 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-667f42fa-9b1e-4cea-a02b-ea5308380b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:34.726063 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:34.781224 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decabd80-ef54-4aa8-b01a-6cff8fc3d7ca None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:34.781541 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decabd80-ef54-4aa8-b01a-6cff8fc3d7ca None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:34.781798 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decabd80-ef54-4aa8-b01a-6cff8fc3d7ca None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:34.783501 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 333/692] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:14:34.788659 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54a8a0-4eea-4373-971e-80e146f09f93 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:34.789044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54a8a0-4eea-4373-971e-80e146f09f93 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:34.789390 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54a8a0-4eea-4373-971e-80e146f09f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:34.789652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 360/693] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:34 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:14:34.810230 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-4d54a8a0-4eea-4373-971e-80e146f09f93 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:34.811623 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-4d54a8a0-4eea-4373-971e-80e146f09f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:34.856880 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:34.892397 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 334/694] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:34 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:14:35.131837 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f42fa-9b1e-4cea-a02b-ea5308380b49 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:35.232662 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54a8a0-4eea-4373-971e-80e146f09f93 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:35.246822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f42fa-9b1e-4cea-a02b-ea5308380b49 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:35.289515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597447e-6f4c-4924-9d77-02d4f46f6866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:35.290085 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597447e-6f4c-4924-9d77-02d4f46f6866 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:35.290369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597447e-6f4c-4924-9d77-02d4f46f6866 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:35.290647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597447e-6f4c-4924-9d77-02d4f46f6866 None admin] PATH_INFO: `/v3/services/image` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:35.291237 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597447e-6f4c-4924-9d77-02d4f46f6866 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:35.293187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597447e-6f4c-4924-9d77-02d4f46f6866 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-4597447e-6f4c-4924-9d77-02d4f46f6866 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:35.302942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:35.304008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:35.304887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 361/695] 10.222.0.43 () {56 vars in 1105 bytes} [Sat Sep 3 21:14:35 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:35.312135 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597447e-6f4c-4924-9d77-02d4f46f6866 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:35.331550 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:35.365919 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54a8a0-4eea-4373-971e-80e146f09f93 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:35.414166 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd1dd4-5e42-482e-8b33-cf6c83a22efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:35.415484 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd1dd4-5e42-482e-8b33-cf6c83a22efb None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:35.415869 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd1dd4-5e42-482e-8b33-cf6c83a22efb None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:35.416248 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd1dd4-5e42-482e-8b33-cf6c83a22efb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:35.417001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd1dd4-5e42-482e-8b33-cf6c83a22efb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:35.420147 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd1dd4-5e42-482e-8b33-cf6c83a22efb None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-35dd1dd4-5e42-482e-8b33-cf6c83a22efb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:35.432067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:35.433628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:35.434569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:35.434569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:35.434569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:35.434569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:35.434569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:35.434569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:35.434569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:35.434569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:35.434569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:35.434569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:35.434569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:35.434569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:35.434569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 21:14:35.434569 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:35.435382 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 335/696] 10.222.0.43 () {56 vars in 1129 bytes} [Sat Sep 3 21:14:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:14:35.440470 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd1dd4-5e42-482e-8b33-cf6c83a22efb None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:35.455423 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597447e-6f4c-4924-9d77-02d4f46f6866 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:35.493153 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:35.498026 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b6c7f-a2e4-4891-8ce0-f8b8c75a24d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:35.498730 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b6c7f-a2e4-4891-8ce0-f8b8c75a24d2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:35.499049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b6c7f-a2e4-4891-8ce0-f8b8c75a24d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:35.499326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b6c7f-a2e4-4891-8ce0-f8b8c75a24d2 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:35.500001 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b6c7f-a2e4-4891-8ce0-f8b8c75a24d2 None admin] RBAC: Adding query filter params (name=image) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:35.500321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b6c7f-a2e4-4891-8ce0-f8b8c75a24d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:35.502049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b6c7f-a2e4-4891-8ce0-f8b8c75a24d2 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:35.512843 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 362/697] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:35.514118 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b6c7f-a2e4-4891-8ce0-f8b8c75a24d2 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:35.597510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd1dd4-5e42-482e-8b33-cf6c83a22efb None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:35.603789 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:35.629502 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b6c7f-a2e4-4891-8ce0-f8b8c75a24d2 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:35.645447 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c6ce5-c166-47d4-8b33-8e8ab91f17e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:35.646439 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6ce5-c166-47d4-8b33-8e8ab91f17e1 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:35.646926 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6ce5-c166-47d4-8b33-8e8ab91f17e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:35.647404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c6ce5-c166-47d4-8b33-8e8ab91f17e1 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:35.648492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c6ce5-c166-47d4-8b33-8e8ab91f17e1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:35.649077 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c6ce5-c166-47d4-8b33-8e8ab91f17e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:35.650695 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c6ce5-c166-47d4-8b33-8e8ab91f17e1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:35.658199 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 336/698] 10.222.0.43 () {56 vars in 1124 bytes} [Sat Sep 3 21:14:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:35.659815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628693-9d77-41c8-8eda-f2e642ce2a7f None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:35.660307 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628693-9d77-41c8-8eda-f2e642ce2a7f None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:35.660830 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38628693-9d77-41c8-8eda-f2e642ce2a7f None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:35.662258 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 337/699] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:35.665615 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628693-9d77-41c8-8eda-f2e642ce2a7f None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:35.679933 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57124b-4462-4d8a-99a1-ca3367c2ceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:35.680899 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57124b-4462-4d8a-99a1-ca3367c2ceac None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:35.681187 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57124b-4462-4d8a-99a1-ca3367c2ceac None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:35.682591 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57124b-4462-4d8a-99a1-ca3367c2ceac None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:35.682591 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57124b-4462-4d8a-99a1-ca3367c2ceac None admin] RBAC: Adding query filter params (type=image) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:35.682591 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57124b-4462-4d8a-99a1-ca3367c2ceac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:35.684563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57124b-4462-4d8a-99a1-ca3367c2ceac None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:35.690543 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 363/700] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:35.691743 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f76c1-3cc4-46ac-9135-383912baec71 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:35.692033 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f76c1-3cc4-46ac-9135-383912baec71 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:35.692306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f76c1-3cc4-46ac-9135-383912baec71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:35.721404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-e14f76c1-3cc4-46ac-9135-383912baec71 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:35.722804 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-e14f76c1-3cc4-46ac-9135-383912baec71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:35.803678 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:35.813071 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38628693-9d77-41c8-8eda-f2e642ce2a7f None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:35.824628 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 364/701] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:35 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:14:35.824628 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f76c1-3cc4-46ac-9135-383912baec71 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:35.868874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ace4a-3a15-4552-8c6f-67da21e326e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:35.870229 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ace4a-3a15-4552-8c6f-67da21e326e1 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:35.870229 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ace4a-3a15-4552-8c6f-67da21e326e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:35.870482 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ace4a-3a15-4552-8c6f-67da21e326e1 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:35.872467 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ace4a-3a15-4552-8c6f-67da21e326e1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:35.872875 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ace4a-3a15-4552-8c6f-67da21e326e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:35.874636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ace4a-3a15-4552-8c6f-67da21e326e1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:35.881283 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 338/702] 10.222.0.43 () {56 vars in 1124 bytes} [Sat Sep 3 21:14:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:35.892562 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ace4a-3a15-4552-8c6f-67da21e326e1 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:35.926600 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:35.974308 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f76c1-3cc4-46ac-9135-383912baec71 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:36.019861 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d14a5-80ba-47ae-a43c-acd84f2c316e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:36.020740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d14a5-80ba-47ae-a43c-acd84f2c316e None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:36.021128 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d14a5-80ba-47ae-a43c-acd84f2c316e None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:36.021503 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d14a5-80ba-47ae-a43c-acd84f2c316e None admin] PATH_INFO: `/v3/endpoints` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:36.022148 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ace4a-3a15-4552-8c6f-67da21e326e1 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:36.022801 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d14a5-80ba-47ae-a43c-acd84f2c316e None admin] RBAC: Adding query filter params (interface=public, service_id=9f2b0a220f0a4592a5744c59ebdd408e, region_id=RegionOne) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:36.022953 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d14a5-80ba-47ae-a43c-acd84f2c316e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:36.024781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d14a5-80ba-47ae-a43c-acd84f2c316e None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:36.034494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 365/703] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Sep 3 21:14:35 2022] GET /identity/v3/endpoints?service_id=9f2b0a220f0a4592a5744c59ebdd408e&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:36.039636 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d14a5-80ba-47ae-a43c-acd84f2c316e None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:36.085214 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4e36e-057a-4c58-b965-0fd6404e9806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:36.085866 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4e36e-057a-4c58-b965-0fd6404e9806 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:36.086424 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4e36e-057a-4c58-b965-0fd6404e9806 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:36.086700 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4e36e-057a-4c58-b965-0fd6404e9806 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:36.087455 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4e36e-057a-4c58-b965-0fd6404e9806 None admin] RBAC: Adding query filter params (interface=public, service_id=1b6550498e7a4bd5a3ca838d724c9f0c, region_id=RegionOne) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:36.087769 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4e36e-057a-4c58-b965-0fd6404e9806 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:36.090499 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4e36e-057a-4c58-b965-0fd6404e9806 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:36.101549 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 339/704] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Sep 3 21:14:35 2022] GET /identity/v3/endpoints?service_id=1b6550498e7a4bd5a3ca838d724c9f0c&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:36.108344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4e36e-057a-4c58-b965-0fd6404e9806 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:36.147340 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:36.196862 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d14a5-80ba-47ae-a43c-acd84f2c316e None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:36.236435 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e48a23-0509-4a95-bf23-712af32a9c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:36.237070 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e48a23-0509-4a95-bf23-712af32a9c1a None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:36.237354 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e48a23-0509-4a95-bf23-712af32a9c1a None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:36.237717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e48a23-0509-4a95-bf23-712af32a9c1a None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:36.238226 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e48a23-0509-4a95-bf23-712af32a9c1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:36.239590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e48a23-0509-4a95-bf23-712af32a9c1a None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:36.240900 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:36.241892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4e36e-057a-4c58-b965-0fd6404e9806 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:36.254751 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 366/705] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Sep 3 21:14:36 2022] GET /identity/v3/services => generated 1002 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 21:14:36.254751 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e48a23-0509-4a95-bf23-712af32a9c1a None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:36.283487 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6eadc-c811-417e-a81b-9cb25940c882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:36.284234 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6eadc-c811-417e-a81b-9cb25940c882 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:36.284643 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6eadc-c811-417e-a81b-9cb25940c882 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:36.284980 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6eadc-c811-417e-a81b-9cb25940c882 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:36.285692 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6eadc-c811-417e-a81b-9cb25940c882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:36.287171 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6eadc-c811-417e-a81b-9cb25940c882 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:36.294585 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 340/706] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Sep 3 21:14:36 2022] GET /identity/v3/services => generated 1002 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 21:14:36.295769 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291cddf-fce8-4a2a-bd89-f500f4d2a984 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:36.296058 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291cddf-fce8-4a2a-bd89-f500f4d2a984 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:36.296336 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291cddf-fce8-4a2a-bd89-f500f4d2a984 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:36.297999 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 341/707] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:36.304438 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db71c5e-7918-4072-af6a-1fd1a7c59327 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:36.304785 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db71c5e-7918-4072-af6a-1fd1a7c59327 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:36.305070 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db71c5e-7918-4072-af6a-1fd1a7c59327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:36.345903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-8db71c5e-7918-4072-af6a-1fd1a7c59327 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:36.347827 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-8db71c5e-7918-4072-af6a-1fd1a7c59327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:36.407707 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e48a23-0509-4a95-bf23-712af32a9c1a None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:36.459522 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566a842-0db0-4916-abfa-18f424a45c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:36.460382 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566a842-0db0-4916-abfa-18f424a45c09 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:36.460814 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566a842-0db0-4916-abfa-18f424a45c09 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:36.461192 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566a842-0db0-4916-abfa-18f424a45c09 None admin] PATH_INFO: `/v3/services/network` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:36.462099 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566a842-0db0-4916-abfa-18f424a45c09 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:36.464356 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566a842-0db0-4916-abfa-18f424a45c09 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:36.466541 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 342/708] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:36 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-b566a842-0db0-4916-abfa-18f424a45c09 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:36.477014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:36.478229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:36.479084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 367/709] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:36 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:36.485043 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db71c5e-7918-4072-af6a-1fd1a7c59327 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:36.516608 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:36.616510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db71c5e-7918-4072-af6a-1fd1a7c59327 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:36.655723 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef66397-d21f-4329-9d53-1ad3e85f16cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:36.656622 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef66397-d21f-4329-9d53-1ad3e85f16cb None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:36.657078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef66397-d21f-4329-9d53-1ad3e85f16cb None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:36.657501 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef66397-d21f-4329-9d53-1ad3e85f16cb None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:36.658402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef66397-d21f-4329-9d53-1ad3e85f16cb None admin] RBAC: Adding query filter params (name=network) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:36.658874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef66397-d21f-4329-9d53-1ad3e85f16cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:36.660412 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef66397-d21f-4329-9d53-1ad3e85f16cb None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:36.666306 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 343/710] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Sep 3 21:14:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:36.672231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566a842-0db0-4916-abfa-18f424a45c09 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:36.740997 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:36.783262 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566a842-0db0-4916-abfa-18f424a45c09 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:36.823367 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef66397-d21f-4329-9d53-1ad3e85f16cb None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:36.938059 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:36.949874 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db26b05-efaf-4ed3-8e22-19bfc91968f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:36.950616 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db26b05-efaf-4ed3-8e22-19bfc91968f0 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:36.950973 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db26b05-efaf-4ed3-8e22-19bfc91968f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:36.951320 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db26b05-efaf-4ed3-8e22-19bfc91968f0 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:36.951977 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db26b05-efaf-4ed3-8e22-19bfc91968f0 None admin] RBAC: Adding query filter params (type=network) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:36.952490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db26b05-efaf-4ed3-8e22-19bfc91968f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:36.954057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db26b05-efaf-4ed3-8e22-19bfc91968f0 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:36.959751 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 368/711] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Sep 3 21:14:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:36.960658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef66397-d21f-4329-9d53-1ad3e85f16cb None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:36.967087 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db26b05-efaf-4ed3-8e22-19bfc91968f0 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:37.003059 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64aba1-0b65-4d8c-ace2-f4153c479344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:37.003688 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64aba1-0b65-4d8c-ace2-f4153c479344 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:37.004026 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64aba1-0b65-4d8c-ace2-f4153c479344 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:37.004302 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64aba1-0b65-4d8c-ace2-f4153c479344 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:37.019066 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64aba1-0b65-4d8c-ace2-f4153c479344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-df64aba1-0b65-4d8c-ace2-f4153c479344 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:14:37.024384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:37.025404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:37.026260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:37.026260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:37.026260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:37.026260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:37.026260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:14:37.026260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:14:37.026260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:14:37.026260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:14:37.026260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:14:37.026260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:14:37.026260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:14:37.026260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:37.026260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 344/712] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:14:37.033344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64aba1-0b65-4d8c-ace2-f4153c479344 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:37.100032 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db26b05-efaf-4ed3-8e22-19bfc91968f0 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:37.128798 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:37.137415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cce54d-6857-47d9-9458-6d76fa6d9ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:37.138242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cce54d-6857-47d9-9458-6d76fa6d9ff9 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:37.138355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cce54d-6857-47d9-9458-6d76fa6d9ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:37.141026 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cce54d-6857-47d9-9458-6d76fa6d9ff9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:37.141026 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cce54d-6857-47d9-9458-6d76fa6d9ff9 None admin] RBAC: Adding query filter params (interface=public, service_id=4ed0e7b2bf4a42f9a3dda7d280894838, region_id=RegionOne) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:37.141026 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cce54d-6857-47d9-9458-6d76fa6d9ff9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:37.141026 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cce54d-6857-47d9-9458-6d76fa6d9ff9 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:37.151142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 369/713] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Sep 3 21:14:36 2022] GET /identity/v3/endpoints?service_id=4ed0e7b2bf4a42f9a3dda7d280894838&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:37.153442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cce54d-6857-47d9-9458-6d76fa6d9ff9 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:37.157760 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64aba1-0b65-4d8c-ace2-f4153c479344 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:37.198084 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d168a-d15d-4584-8b01-7ebd132f772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:37.199547 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d168a-d15d-4584-8b01-7ebd132f772a None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:37.200105 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d168a-d15d-4584-8b01-7ebd132f772a None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:37.200649 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d168a-d15d-4584-8b01-7ebd132f772a None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:37.201650 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d168a-d15d-4584-8b01-7ebd132f772a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:37.202213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d168a-d15d-4584-8b01-7ebd132f772a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:37.203904 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d168a-d15d-4584-8b01-7ebd132f772a None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:37.219442 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 345/714] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:14:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:37.221001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d168a-d15d-4584-8b01-7ebd132f772a None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:37.231801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:37.259165 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cce54d-6857-47d9-9458-6d76fa6d9ff9 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:37.296726 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae06e0-909d-41b3-bf70-8d52c14988aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:37.297333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae06e0-909d-41b3-bf70-8d52c14988aa None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:37.297609 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae06e0-909d-41b3-bf70-8d52c14988aa None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:37.297936 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae06e0-909d-41b3-bf70-8d52c14988aa None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:37.298540 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae06e0-909d-41b3-bf70-8d52c14988aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:37.299907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae06e0-909d-41b3-bf70-8d52c14988aa None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:37.312706 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 370/715] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Sep 3 21:14:37 2022] GET /identity/v3/services => generated 1002 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 21:14:37.347291 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d168a-d15d-4584-8b01-7ebd132f772a None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:37.388730 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8b9b1-5cef-4852-999d-816637624dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:37.389488 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8b9b1-5cef-4852-999d-816637624dff None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:37.389780 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8b9b1-5cef-4852-999d-816637624dff None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:37.390052 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8b9b1-5cef-4852-999d-816637624dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:37.403073 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8b9b1-5cef-4852-999d-816637624dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:37.404620 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8b9b1-5cef-4852-999d-816637624dff None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-a9a8b9b1-5cef-4852-999d-816637624dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:37.421756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:37.422843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:37.423851 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:37.423851 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:37.423851 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:37.423851 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 346/716] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:37.430605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae06e0-909d-41b3-bf70-8d52c14988aa None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:37.498893 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:37.548742 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae06e0-909d-41b3-bf70-8d52c14988aa None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:37.592295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f72958-4e41-4f76-ad97-b564e319ac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:37.592989 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f72958-4e41-4f76-ad97-b564e319ac2e None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:37.593268 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f72958-4e41-4f76-ad97-b564e319ac2e None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:37.593542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f72958-4e41-4f76-ad97-b564e319ac2e None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:37.594188 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f72958-4e41-4f76-ad97-b564e319ac2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:37.594490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f72958-4e41-4f76-ad97-b564e319ac2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:37.595868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f72958-4e41-4f76-ad97-b564e319ac2e None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:37.609836 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 371/717] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:37.615465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8b9b1-5cef-4852-999d-816637624dff None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:37.680357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:37.728173 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8b9b1-5cef-4852-999d-816637624dff None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:37.768538 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789ba2d-e0ea-4a7e-8f98-84de04be5f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:37.769165 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789ba2d-e0ea-4a7e-8f98-84de04be5f3c None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:37.769449 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789ba2d-e0ea-4a7e-8f98-84de04be5f3c None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:37.769722 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789ba2d-e0ea-4a7e-8f98-84de04be5f3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:37.778804 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789ba2d-e0ea-4a7e-8f98-84de04be5f3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:37.780343 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789ba2d-e0ea-4a7e-8f98-84de04be5f3c None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-5789ba2d-e0ea-4a7e-8f98-84de04be5f3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:14:37.793114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:37.794140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:37.795116 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:37.795116 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:37.795116 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:14:37.795116 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:14:37.795116 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:14:37.795116 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:14:37.795116 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:14:37.795116 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:14:37.795116 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 03 21:14:37.795116 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:37.795116 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 347/718] 10.222.0.43 () {56 vars in 1093 bytes} [Sat Sep 3 21:14:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:37.802112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f72958-4e41-4f76-ad97-b564e319ac2e None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:37.926989 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f72958-4e41-4f76-ad97-b564e319ac2e None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:37.942976 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:37.966350 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b65c4-40ff-4c32-abb9-e2ba7ee3e8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:37.967475 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b65c4-40ff-4c32-abb9-e2ba7ee3e8b8 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:37.967963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b65c4-40ff-4c32-abb9-e2ba7ee3e8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:37.968442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b65c4-40ff-4c32-abb9-e2ba7ee3e8b8 None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:37.969330 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b65c4-40ff-4c32-abb9-e2ba7ee3e8b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:37.969845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b65c4-40ff-4c32-abb9-e2ba7ee3e8b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:37.971570 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b65c4-40ff-4c32-abb9-e2ba7ee3e8b8 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:37.992942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 372/719] 10.222.0.43 () {56 vars in 1133 bytes} [Sat Sep 3 21:14:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:37.998735 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789ba2d-e0ea-4a7e-8f98-84de04be5f3c None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:38.133226 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789ba2d-e0ea-4a7e-8f98-84de04be5f3c None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:38.153507 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:38.172466 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda784f-05ee-46c1-bfa4-1e517589fc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:38.173168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda784f-05ee-46c1-bfa4-1e517589fc51 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:38.173450 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda784f-05ee-46c1-bfa4-1e517589fc51 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:38.173726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda784f-05ee-46c1-bfa4-1e517589fc51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:38.252624 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda784f-05ee-46c1-bfa4-1e517589fc51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:38.254125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda784f-05ee-46c1-bfa4-1e517589fc51 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:38.360851 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 348/720] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:14:37 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 21:14:38.366450 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b65c4-40ff-4c32-abb9-e2ba7ee3e8b8 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:38.477197 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b65c4-40ff-4c32-abb9-e2ba7ee3e8b8 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:38.518643 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff40565-0b75-4b4a-8dcc-c05d97560437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:38.519285 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40565-0b75-4b4a-8dcc-c05d97560437 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:38.519565 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40565-0b75-4b4a-8dcc-c05d97560437 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:38.519838 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff40565-0b75-4b4a-8dcc-c05d97560437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:38.531920 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff40565-0b75-4b4a-8dcc-c05d97560437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:38.533445 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff40565-0b75-4b4a-8dcc-c05d97560437 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-cff40565-0b75-4b4a-8dcc-c05d97560437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:38.550313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:38.551377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:38.552278 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:38.552278 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:38.552278 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:38.552278 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 373/721] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:38.559826 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda784f-05ee-46c1-bfa4-1e517589fc51 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:38.586980 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:38.686908 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda784f-05ee-46c1-bfa4-1e517589fc51 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:38.728951 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589db9bb-b370-4d75-bad0-1bc6dd399033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:38.729931 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589db9bb-b370-4d75-bad0-1bc6dd399033 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:38.730996 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589db9bb-b370-4d75-bad0-1bc6dd399033 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:38.731511 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589db9bb-b370-4d75-bad0-1bc6dd399033 None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:38.732386 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589db9bb-b370-4d75-bad0-1bc6dd399033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:38.732945 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589db9bb-b370-4d75-bad0-1bc6dd399033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:38.734561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589db9bb-b370-4d75-bad0-1bc6dd399033 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:38.736591 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884349-886b-4c76-8745-cd7693467ee3 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:38.736881 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884349-886b-4c76-8745-cd7693467ee3 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:38.737155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884349-886b-4c76-8745-cd7693467ee3 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:38.739798 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 374/722] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:38.744042 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82110687-c25b-4254-9be8-e8c4c7bc241b None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:38.744323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82110687-c25b-4254-9be8-e8c4c7bc241b None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:38.744621 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82110687-c25b-4254-9be8-e8c4c7bc241b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:38.751105 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 349/723] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:38.757675 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589db9bb-b370-4d75-bad0-1bc6dd399033 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:38.765850 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-82110687-c25b-4254-9be8-e8c4c7bc241b None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:38.767090 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-82110687-c25b-4254-9be8-e8c4c7bc241b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:38.802776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:38.899750 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 375/724] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:38 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 21:14:38.902130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:38.940235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589db9bb-b370-4d75-bad0-1bc6dd399033 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:39.001222 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb23d1-2f75-4a96-ae74-b21e2872d2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:39.002500 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb23d1-2f75-4a96-ae74-b21e2872d2af None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:39.003034 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb23d1-2f75-4a96-ae74-b21e2872d2af None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:39.003524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb23d1-2f75-4a96-ae74-b21e2872d2af None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:39.020259 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb23d1-2f75-4a96-ae74-b21e2872d2af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:39.020259 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb23d1-2f75-4a96-ae74-b21e2872d2af None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-8cbb23d1-2f75-4a96-ae74-b21e2872d2af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:39.041774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:39.043267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:39.044213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:39.044213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:39.044213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:39.044213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:39.044213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:39.044213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:39.044213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:39.044213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:39.045329 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 350/725] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:14:39.051302 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82110687-c25b-4254-9be8-e8c4c7bc241b None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:39.175655 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82110687-c25b-4254-9be8-e8c4c7bc241b None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:39.213130 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18152ad-48f4-48b5-baa2-3d35516ecabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:39.213793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18152ad-48f4-48b5-baa2-3d35516ecabd None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:39.214078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18152ad-48f4-48b5-baa2-3d35516ecabd None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:39.214352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18152ad-48f4-48b5-baa2-3d35516ecabd None admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:39.216071 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18152ad-48f4-48b5-baa2-3d35516ecabd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:39.216399 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18152ad-48f4-48b5-baa2-3d35516ecabd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:39.217869 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18152ad-48f4-48b5-baa2-3d35516ecabd None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:39.233061 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 376/726] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:14:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:39.241716 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb23d1-2f75-4a96-ae74-b21e2872d2af None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:39.248281 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a1272-c4ac-4885-993a-086e685f9d68 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:39.248671 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a1272-c4ac-4885-993a-086e685f9d68 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:39.248966 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a1272-c4ac-4885-993a-086e685f9d68 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:39.250556 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 377/727] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:14:39.256403 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80e2a3-09e1-4d34-a6a0-684470e47d8f None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:39.256650 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80e2a3-09e1-4d34-a6a0-684470e47d8f None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:39.257520 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80e2a3-09e1-4d34-a6a0-684470e47d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:39.278853 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-8f80e2a3-09e1-4d34-a6a0-684470e47d8f None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:39.280254 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-8f80e2a3-09e1-4d34-a6a0-684470e47d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:39.291747 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:39.367965 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 378/728] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:39 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:14:39.372847 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80e2a3-09e1-4d34-a6a0-684470e47d8f None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:39.380422 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb23d1-2f75-4a96-ae74-b21e2872d2af None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:39.421548 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5837f-177d-4ae5-a4d6-88fbc9806c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:39.422159 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5837f-177d-4ae5-a4d6-88fbc9806c37 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:39.422507 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5837f-177d-4ae5-a4d6-88fbc9806c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:39.422782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5837f-177d-4ae5-a4d6-88fbc9806c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:39.423504 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5837f-177d-4ae5-a4d6-88fbc9806c37 None admin] RBAC: Adding query filter params (role.id=a1c22a1558c34c1d9d262bf1da31887e, scope.project.id=3bae29e3189d480c9200f03128f0c607, user.id=7d95ba5e28764ed49d1142fecb16adab) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:39.423870 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5837f-177d-4ae5-a4d6-88fbc9806c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:39.425565 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5837f-177d-4ae5-a4d6-88fbc9806c37 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:39.433302 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 351/729] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:14:39 2022] GET /identity/v3/role_assignments?user.id=7d95ba5e28764ed49d1142fecb16adab&scope.project.id=3bae29e3189d480c9200f03128f0c607&role.id=a1c22a1558c34c1d9d262bf1da31887e => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:39.505091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80e2a3-09e1-4d34-a6a0-684470e47d8f None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:39.547421 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a419f75-1688-4d98-8aa8-d27d2514b4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:39.548369 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a419f75-1688-4d98-8aa8-d27d2514b4b8 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:39.548873 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a419f75-1688-4d98-8aa8-d27d2514b4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:39.549304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a419f75-1688-4d98-8aa8-d27d2514b4b8 None admin] PATH_INFO: `/v3/services/image` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:39.550042 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a419f75-1688-4d98-8aa8-d27d2514b4b8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:39.551644 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a419f75-1688-4d98-8aa8-d27d2514b4b8 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-5a419f75-1688-4d98-8aa8-d27d2514b4b8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:39.562240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:39.563610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:39.564739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:39.564739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:39.564739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:39.564739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:39.564739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:39.564739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:39.564739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:39.564739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:39.564739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:39.564739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:39.564739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:39.564739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:39.564739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 03 21:14:39.564739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:39.566090 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 379/730] 10.222.0.43 () {56 vars in 1105 bytes} [Sat Sep 3 21:14:39 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:39.575806 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5837f-177d-4ae5-a4d6-88fbc9806c37 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:39.578171 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:39.688395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5837f-177d-4ae5-a4d6-88fbc9806c37 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:39.731185 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae472ac-64d1-4334-bf54-22621acb20f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:39.732273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae472ac-64d1-4334-bf54-22621acb20f4 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:39.732826 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae472ac-64d1-4334-bf54-22621acb20f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:39.733409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae472ac-64d1-4334-bf54-22621acb20f4 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:39.734817 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae472ac-64d1-4334-bf54-22621acb20f4 None admin] RBAC: Adding query filter params (name=image) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:39.735677 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae472ac-64d1-4334-bf54-22621acb20f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:39.738221 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a419f75-1688-4d98-8aa8-d27d2514b4b8 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:39.739199 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae472ac-64d1-4334-bf54-22621acb20f4 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:39.751484 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 352/731] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:39.758902 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:39.761238 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae472ac-64d1-4334-bf54-22621acb20f4 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:39.837555 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:39.864666 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a419f75-1688-4d98-8aa8-d27d2514b4b8 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:39.876683 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae472ac-64d1-4334-bf54-22621acb20f4 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:39.905359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec10d3-7a49-43d2-af18-e9644e45d728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:39.906491 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec10d3-7a49-43d2-af18-e9644e45d728 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:39.906773 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec10d3-7a49-43d2-af18-e9644e45d728 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:39.907039 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec10d3-7a49-43d2-af18-e9644e45d728 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:39.907711 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec10d3-7a49-43d2-af18-e9644e45d728 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:39.909112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec10d3-7a49-43d2-af18-e9644e45d728 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:39.915301 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6b08a-2355-48fb-ab24-1ae4389b7b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:39.915913 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6b08a-2355-48fb-ab24-1ae4389b7b94 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:39.916199 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6b08a-2355-48fb-ab24-1ae4389b7b94 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:39.916472 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6b08a-2355-48fb-ab24-1ae4389b7b94 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:39.917131 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6b08a-2355-48fb-ab24-1ae4389b7b94 None admin] RBAC: Adding query filter params (type=image) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:39.917438 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6b08a-2355-48fb-ab24-1ae4389b7b94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-bdec10d3-7a49-43d2-af18-e9644e45d728 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:39.918865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:39.919827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:39.920728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:39.920728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:39.920728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:39.920728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:39.920728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:39.920728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:39.920728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:39.920728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:39.920728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:39.920728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:39.920728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:39.920728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:39.920728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 03 21:14:39.920728 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:39.921522 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad6b08a-2355-48fb-ab24-1ae4389b7b94 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:39.921620 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 380/732] 10.222.0.43 () {56 vars in 1129 bytes} [Sat Sep 3 21:14:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:39.921620 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf31a0-7615-4e36-be72-304e4169d0c9 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:39.922272 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf31a0-7615-4e36-be72-304e4169d0c9 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:39.922272 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf31a0-7615-4e36-be72-304e4169d0c9 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:39.923469 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 381/733] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:39.928133 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf31a0-7615-4e36-be72-304e4169d0c9 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:39.930827 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 353/734] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:39.932378 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4331ef1-0d0f-4179-9e27-73d6c03d08ca None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:39.932785 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4331ef1-0d0f-4179-9e27-73d6c03d08ca None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:39.933089 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4331ef1-0d0f-4179-9e27-73d6c03d08ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:39.951928 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-a4331ef1-0d0f-4179-9e27-73d6c03d08ca None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:39.953178 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-a4331ef1-0d0f-4179-9e27-73d6c03d08ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:40.019929 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:40.029954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 354/735] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:39 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:14:40.030670 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4331ef1-0d0f-4179-9e27-73d6c03d08ca None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:40.066645 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf31a0-7615-4e36-be72-304e4169d0c9 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:40.099077 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:40.124016 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066dcfe-4c71-4ec9-91cc-d4959d49b6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:40.125322 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066dcfe-4c71-4ec9-91cc-d4959d49b6f3 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:40.125845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066dcfe-4c71-4ec9-91cc-d4959d49b6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:40.126685 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066dcfe-4c71-4ec9-91cc-d4959d49b6f3 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:40.127838 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066dcfe-4c71-4ec9-91cc-d4959d49b6f3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:40.128364 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066dcfe-4c71-4ec9-91cc-d4959d49b6f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:40.130517 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066dcfe-4c71-4ec9-91cc-d4959d49b6f3 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:40.143388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 382/736] 10.222.0.43 () {56 vars in 1124 bytes} [Sat Sep 3 21:14:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:40.145108 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066dcfe-4c71-4ec9-91cc-d4959d49b6f3 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:40.153368 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4331ef1-0d0f-4179-9e27-73d6c03d08ca None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:40.196397 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df88c6-9173-4bbf-9c0d-a7fc32ed53b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:40.197601 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df88c6-9173-4bbf-9c0d-a7fc32ed53b7 None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:40.198094 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df88c6-9173-4bbf-9c0d-a7fc32ed53b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:40.199447 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df88c6-9173-4bbf-9c0d-a7fc32ed53b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:40.200608 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df88c6-9173-4bbf-9c0d-a7fc32ed53b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:40.202470 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df88c6-9173-4bbf-9c0d-a7fc32ed53b7 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:40.267671 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066dcfe-4c71-4ec9-91cc-d4959d49b6f3 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:40.312244 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 355/737] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Sep 3 21:14:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:14:40.325996 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:40.331387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedbb1f-41d9-446f-b8b2-2aea7b259e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:40.332011 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedbb1f-41d9-446f-b8b2-2aea7b259e2e None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:40.332284 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedbb1f-41d9-446f-b8b2-2aea7b259e2e None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:40.332573 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedbb1f-41d9-446f-b8b2-2aea7b259e2e None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:40.333211 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedbb1f-41d9-446f-b8b2-2aea7b259e2e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:40.333668 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedbb1f-41d9-446f-b8b2-2aea7b259e2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:40.335000 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedbb1f-41d9-446f-b8b2-2aea7b259e2e None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:40.341532 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 383/738] 10.222.0.43 () {56 vars in 1124 bytes} [Sat Sep 3 21:14:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:40.348864 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df88c6-9173-4bbf-9c0d-a7fc32ed53b7 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:40.385042 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedbb1f-41d9-446f-b8b2-2aea7b259e2e None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:40.500874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df88c6-9173-4bbf-9c0d-a7fc32ed53b7 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:40.509377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedbb1f-41d9-446f-b8b2-2aea7b259e2e None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:40.523181 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:40.544903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc664e1b-05bd-4014-8ae7-b8e720a3bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:40.545515 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc664e1b-05bd-4014-8ae7-b8e720a3bf5f None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:40.545797 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc664e1b-05bd-4014-8ae7-b8e720a3bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:40.546077 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc664e1b-05bd-4014-8ae7-b8e720a3bf5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:40.546759 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc664e1b-05bd-4014-8ae7-b8e720a3bf5f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:40.548225 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc664e1b-05bd-4014-8ae7-b8e720a3bf5f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:40.560097 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c0f33-c254-4397-ab41-64857d261c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:40.561121 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0f33-c254-4397-ab41-64857d261c7b None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:40.561403 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0f33-c254-4397-ab41-64857d261c7b None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:40.561658 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c0f33-c254-4397-ab41-64857d261c7b None admin] PATH_INFO: `/v3/services/network` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:40.562291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c0f33-c254-4397-ab41-64857d261c7b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:40.563729 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c0f33-c254-4397-ab41-64857d261c7b None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-264c0f33-c254-4397-ab41-64857d261c7b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:40.574123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:40.577231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:40.578078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 384/739] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:40 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:14:40.580864 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c0f33-c254-4397-ab41-64857d261c7b None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:40.643984 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:40.663438 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 356/740] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Sep 3 21:14:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:14:40.701132 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c0f33-c254-4397-ab41-64857d261c7b None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:40.752687 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b254e24-0265-41e4-aab3-214a5d41beca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:40.753359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b254e24-0265-41e4-aab3-214a5d41beca None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:40.753639 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b254e24-0265-41e4-aab3-214a5d41beca None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:40.753909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b254e24-0265-41e4-aab3-214a5d41beca None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:40.754598 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b254e24-0265-41e4-aab3-214a5d41beca None admin] RBAC: Adding query filter params (name=network) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:40.754906 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b254e24-0265-41e4-aab3-214a5d41beca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:40.756473 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b254e24-0265-41e4-aab3-214a5d41beca None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:40.762387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 385/741] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Sep 3 21:14:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:40.768990 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc664e1b-05bd-4014-8ae7-b8e720a3bf5f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:40.898906 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc664e1b-05bd-4014-8ae7-b8e720a3bf5f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:40.943814 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0bf3ec-9aaa-4e50-94cf-d7d656f991da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:40.944434 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bf3ec-9aaa-4e50-94cf-d7d656f991da None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:40.944797 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bf3ec-9aaa-4e50-94cf-d7d656f991da None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:40.945129 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0bf3ec-9aaa-4e50-94cf-d7d656f991da None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:40.945774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bf3ec-9aaa-4e50-94cf-d7d656f991da None admin] RBAC: Adding query filter params (type=network) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:40.946153 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bf3ec-9aaa-4e50-94cf-d7d656f991da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:40.947654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0bf3ec-9aaa-4e50-94cf-d7d656f991da None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:40.954317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 357/742] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Sep 3 21:14:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:40.960560 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b254e24-0265-41e4-aab3-214a5d41beca None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:41.077970 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b254e24-0265-41e4-aab3-214a5d41beca None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:41.100425 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:41.119349 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105302c6-cbd2-44c9-9544-2411e5863417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:41.120318 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105302c6-cbd2-44c9-9544-2411e5863417 None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:41.120906 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105302c6-cbd2-44c9-9544-2411e5863417 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:41.121664 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105302c6-cbd2-44c9-9544-2411e5863417 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:41.122770 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105302c6-cbd2-44c9-9544-2411e5863417 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:41.124501 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105302c6-cbd2-44c9-9544-2411e5863417 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:41.206152 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 386/743] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Sep 3 21:14:40 2022] POST /identity/v3/endpoints => generated 337 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:14:41.895769 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b80a6d-dacf-455c-b172-755e0f522144 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:41.896336 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b80a6d-dacf-455c-b172-755e0f522144 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:41.896336 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b80a6d-dacf-455c-b172-755e0f522144 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:41.897828 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 358/744] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:41.903229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba07ef-442d-4db8-8a72-a1ea0b0934a8 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:41.903511 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba07ef-442d-4db8-8a72-a1ea0b0934a8 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:41.903787 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba07ef-442d-4db8-8a72-a1ea0b0934a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:41.924381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-4bba07ef-442d-4db8-8a72-a1ea0b0934a8 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:41.925587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-4bba07ef-442d-4db8-8a72-a1ea0b0934a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:42.002859 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 387/745] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:41 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 21:14:42.338095 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b80a6d-dacf-455c-b172-755e0f522144 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:42.378618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:42.454055 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b80a6d-dacf-455c-b172-755e0f522144 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:42.493787 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f5dc7-a3f5-442a-b19b-4a8b98bc555a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:42.494416 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5dc7-a3f5-442a-b19b-4a8b98bc555a None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:42.494695 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5dc7-a3f5-442a-b19b-4a8b98bc555a None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:42.494961 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5dc7-a3f5-442a-b19b-4a8b98bc555a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:42.495568 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f5dc7-a3f5-442a-b19b-4a8b98bc555a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:42.497117 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f5dc7-a3f5-442a-b19b-4a8b98bc555a None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-611f5dc7-a3f5-442a-b19b-4a8b98bc555a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:42.507024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:42.508047 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:42.508983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 359/746] 10.222.0.43 () {56 vars in 1132 bytes} [Sat Sep 3 21:14:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:42.518943 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba07ef-442d-4db8-8a72-a1ea0b0934a8 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:42.635529 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba07ef-442d-4db8-8a72-a1ea0b0934a8 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:42.638176 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:42.674477 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67b50b-36c4-4ad1-bd40-b78f3b003853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:42.675088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67b50b-36c4-4ad1-bd40-b78f3b003853 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:42.675371 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67b50b-36c4-4ad1-bd40-b78f3b003853 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:42.675655 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67b50b-36c4-4ad1-bd40-b78f3b003853 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:42.676444 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67b50b-36c4-4ad1-bd40-b78f3b003853 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:42.676853 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67b50b-36c4-4ad1-bd40-b78f3b003853 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:42.678268 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67b50b-36c4-4ad1-bd40-b78f3b003853 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:42.687202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 388/747] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Sep 3 21:14:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:42.689750 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f5dc7-a3f5-442a-b19b-4a8b98bc555a None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:42.766278 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd03adf-484a-4466-92d8-a8d3c3b7d4fc None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:42.766643 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd03adf-484a-4466-92d8-a8d3c3b7d4fc None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:42.766839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd03adf-484a-4466-92d8-a8d3c3b7d4fc None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:42.768309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 389/748] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:14:42.773685 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb143200-6969-4eb5-b01d-257617cc0816 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:42.773996 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb143200-6969-4eb5-b01d-257617cc0816 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:42.774278 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb143200-6969-4eb5-b01d-257617cc0816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:42.796907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-cb143200-6969-4eb5-b01d-257617cc0816 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:42.798143 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-cb143200-6969-4eb5-b01d-257617cc0816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:42.806540 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:42.812110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f5dc7-a3f5-442a-b19b-4a8b98bc555a None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:42.858111 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc9ec9-9dd7-42f7-a4a4-58851b726074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:42.858736 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc9ec9-9dd7-42f7-a4a4-58851b726074 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:42.859230 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc9ec9-9dd7-42f7-a4a4-58851b726074 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:42.859447 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc9ec9-9dd7-42f7-a4a4-58851b726074 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:42.860268 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc9ec9-9dd7-42f7-a4a4-58851b726074 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:42.860498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc9ec9-9dd7-42f7-a4a4-58851b726074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:42.862013 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc9ec9-9dd7-42f7-a4a4-58851b726074 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:42.873717 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 360/749] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Sep 3 21:14:42 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:42.891778 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 390/750] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:42 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 21:14:42.999508 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c3ebe-10c9-4a8b-b994-467e6561e6cd None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:43.000081 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c3ebe-10c9-4a8b-b994-467e6561e6cd None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:43.000081 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c3ebe-10c9-4a8b-b994-467e6561e6cd None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:43.001708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 361/751] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:43.007667 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed86f3-8e87-4089-8f53-03df593f584c None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:43.008221 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed86f3-8e87-4089-8f53-03df593f584c None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:43.008221 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed86f3-8e87-4089-8f53-03df593f584c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:43.029057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-33ed86f3-8e87-4089-8f53-03df593f584c None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:43.030285 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-33ed86f3-8e87-4089-8f53-03df593f584c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:43.106103 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 391/752] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:43 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:14:43.222198 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c3ebe-10c9-4a8b-b994-467e6561e6cd None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:43.336149 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c3ebe-10c9-4a8b-b994-467e6561e6cd None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:43.371948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a811a3-f37b-4be7-bd86-52b60d5bfa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:43.372610 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a811a3-f37b-4be7-bd86-52b60d5bfa9e None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:43.372902 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a811a3-f37b-4be7-bd86-52b60d5bfa9e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:43.373307 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a811a3-f37b-4be7-bd86-52b60d5bfa9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:43.406786 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:43.440604 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed86f3-8e87-4089-8f53-03df593f584c None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:43.447287 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a811a3-f37b-4be7-bd86-52b60d5bfa9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:43.449497 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a811a3-f37b-4be7-bd86-52b60d5bfa9e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:43.471027 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:43.560845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed86f3-8e87-4089-8f53-03df593f584c None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:43.563949 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 362/753] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:14:43 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 21:14:43.569913 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a811a3-f37b-4be7-bd86-52b60d5bfa9e None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:43.600276 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d709f3-04f6-4e4c-9147-0a010b6ee4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:43.600955 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d709f3-04f6-4e4c-9147-0a010b6ee4d2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:43.601231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d709f3-04f6-4e4c-9147-0a010b6ee4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:43.601472 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d709f3-04f6-4e4c-9147-0a010b6ee4d2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:43.602016 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d709f3-04f6-4e4c-9147-0a010b6ee4d2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:43.603376 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d709f3-04f6-4e4c-9147-0a010b6ee4d2 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-e1d709f3-04f6-4e4c-9147-0a010b6ee4d2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:43.613214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:43.614304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:43.617897 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 392/754] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:14:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:14:43.621652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d709f3-04f6-4e4c-9147-0a010b6ee4d2 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:43.646552 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:43.690477 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a811a3-f37b-4be7-bd86-52b60d5bfa9e None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:43.719001 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:43.727679 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2511d-085c-46b0-81ba-002709caaeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:43.728355 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2511d-085c-46b0-81ba-002709caaeff None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:43.728465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d709f3-04f6-4e4c-9147-0a010b6ee4d2 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:43.728719 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2511d-085c-46b0-81ba-002709caaeff None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:43.728996 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2511d-085c-46b0-81ba-002709caaeff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:43.741187 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2511d-085c-46b0-81ba-002709caaeff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:43.743224 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2511d-085c-46b0-81ba-002709caaeff None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-71b2511d-085c-46b0-81ba-002709caaeff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:14:43.759820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:43.761476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:14:43.762600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:14:43.762600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:14:43.762600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:43.762600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 363/755] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:14:43.766864 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf2205-f6ab-4077-992e-287b93dfb663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:43.766998 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2511d-085c-46b0-81ba-002709caaeff None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:43.767475 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf2205-f6ab-4077-992e-287b93dfb663 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:43.767805 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf2205-f6ab-4077-992e-287b93dfb663 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:43.768025 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf2205-f6ab-4077-992e-287b93dfb663 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:43.768681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf2205-f6ab-4077-992e-287b93dfb663 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:43.768988 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf2205-f6ab-4077-992e-287b93dfb663 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:43.770425 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf2205-f6ab-4077-992e-287b93dfb663 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:43.776151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 393/756] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:14:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:43.782735 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf2205-f6ab-4077-992e-287b93dfb663 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:43.881642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2511d-085c-46b0-81ba-002709caaeff None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:43.896106 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf2205-f6ab-4077-992e-287b93dfb663 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:43.899985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:43.919818 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9e030-5f0f-4f60-8226-5c3a6b4aa845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:43.920506 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9e030-5f0f-4f60-8226-5c3a6b4aa845 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:43.920887 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9e030-5f0f-4f60-8226-5c3a6b4aa845 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:43.921230 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9e030-5f0f-4f60-8226-5c3a6b4aa845 None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:43.921944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9e030-5f0f-4f60-8226-5c3a6b4aa845 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:43.922341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9e030-5f0f-4f60-8226-5c3a6b4aa845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:43.923811 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9e030-5f0f-4f60-8226-5c3a6b4aa845 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:43.948788 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635acbf4-999f-45ab-b823-e7ac595e7d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:43.949513 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 364/757] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:43.949612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635acbf4-999f-45ab-b823-e7ac595e7d95 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:43.949612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635acbf4-999f-45ab-b823-e7ac595e7d95 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:43.949612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635acbf4-999f-45ab-b823-e7ac595e7d95 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:43.949612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635acbf4-999f-45ab-b823-e7ac595e7d95 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:43.949612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635acbf4-999f-45ab-b823-e7ac595e7d95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:43.949612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635acbf4-999f-45ab-b823-e7ac595e7d95 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:43.954705 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 394/758] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:14:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:14:45.151578 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719583f6-bbe5-44cc-af82-0566a02f57ba None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:45.152751 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719583f6-bbe5-44cc-af82-0566a02f57ba None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:45.152751 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719583f6-bbe5-44cc-af82-0566a02f57ba None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:45.154579 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 365/759] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:45.159633 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6661e5-b81b-4548-adea-abdfaed4c9dd None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:45.160058 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6661e5-b81b-4548-adea-abdfaed4c9dd None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:45.160204 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6661e5-b81b-4548-adea-abdfaed4c9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:45.180078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-9b6661e5-b81b-4548-adea-abdfaed4c9dd None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:45.181302 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-9b6661e5-b81b-4548-adea-abdfaed4c9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:45.194467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:45.248193 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 395/760] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:45 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 21:14:45.577315 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719583f6-bbe5-44cc-af82-0566a02f57ba None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:45.679339 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719583f6-bbe5-44cc-af82-0566a02f57ba None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:45.713352 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37377813-f1ea-499b-a06b-0c666ef24821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:45.713946 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37377813-f1ea-499b-a06b-0c666ef24821 None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:45.714218 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37377813-f1ea-499b-a06b-0c666ef24821 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:45.714485 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37377813-f1ea-499b-a06b-0c666ef24821 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:45.715161 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37377813-f1ea-499b-a06b-0c666ef24821 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:45.716559 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37377813-f1ea-499b-a06b-0c666ef24821 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:45.817165 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 366/761] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Sep 3 21:14:45 2022] POST /identity/v3/services => generated 269 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:14:46.217602 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a6977-cc23-4091-ba8c-787524067537 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:46.218120 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a6977-cc23-4091-ba8c-787524067537 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:46.218120 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a6977-cc23-4091-ba8c-787524067537 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:46.219460 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 396/762] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:46.224669 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976a44-0336-4c0b-a3fe-b33b61df7cd0 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:46.225105 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976a44-0336-4c0b-a3fe-b33b61df7cd0 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:46.225294 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976a44-0336-4c0b-a3fe-b33b61df7cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:46.243577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-09976a44-0336-4c0b-a3fe-b33b61df7cd0 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:46.244789 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-09976a44-0336-4c0b-a3fe-b33b61df7cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:46.274851 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:46.319932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 367/763] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:46 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:14:46.652786 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a6977-cc23-4091-ba8c-787524067537 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:46.753900 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a6977-cc23-4091-ba8c-787524067537 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:46.787986 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903f980-8aa5-4ea3-bffa-1573347b558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:46.788602 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903f980-8aa5-4ea3-bffa-1573347b558c None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:46.788880 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903f980-8aa5-4ea3-bffa-1573347b558c None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:46.789147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903f980-8aa5-4ea3-bffa-1573347b558c None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:46.789780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903f980-8aa5-4ea3-bffa-1573347b558c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:46.791213 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903f980-8aa5-4ea3-bffa-1573347b558c None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:46.919373 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 397/764] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Sep 3 21:14:46 2022] POST /identity/v3/services => generated 251 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:14:48.076493 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8757f9-f2a1-4263-8554-88023bc2aaaa None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:48.077090 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8757f9-f2a1-4263-8554-88023bc2aaaa None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:48.077090 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8757f9-f2a1-4263-8554-88023bc2aaaa None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:48.078415 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 368/765] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:48.084040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58eea1-f04b-4fca-8a1a-9a1728f04116 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:48.084498 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58eea1-f04b-4fca-8a1a-9a1728f04116 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:48.084745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58eea1-f04b-4fca-8a1a-9a1728f04116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:48.103494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-6b58eea1-f04b-4fca-8a1a-9a1728f04116 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:48.104743 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-6b58eea1-f04b-4fca-8a1a-9a1728f04116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:48.107638 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:48.178857 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 398/766] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:48 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:14:48.506233 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8757f9-f2a1-4263-8554-88023bc2aaaa None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:48.615247 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8757f9-f2a1-4263-8554-88023bc2aaaa None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:48.649497 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e878d-7ba8-480c-9c90-a6d0befe288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:48.650121 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e878d-7ba8-480c-9c90-a6d0befe288b None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:48.650393 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e878d-7ba8-480c-9c90-a6d0befe288b None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:48.650667 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e878d-7ba8-480c-9c90-a6d0befe288b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:48.651238 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e878d-7ba8-480c-9c90-a6d0befe288b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:48.653465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e878d-7ba8-480c-9c90-a6d0befe288b None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-eb6e878d-7ba8-480c-9c90-a6d0befe288b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:48.662192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:48.663168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:48.664133 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 369/767] 10.222.0.43 () {56 vars in 1132 bytes} [Sat Sep 3 21:14:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:48.669550 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58eea1-f04b-4fca-8a1a-9a1728f04116 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:48.769694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58eea1-f04b-4fca-8a1a-9a1728f04116 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:48.804726 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa9a98-dcf8-4a4d-a21b-3aed4a873882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:48.805330 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa9a98-dcf8-4a4d-a21b-3aed4a873882 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:48.805606 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa9a98-dcf8-4a4d-a21b-3aed4a873882 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:48.805876 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa9a98-dcf8-4a4d-a21b-3aed4a873882 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:48.806494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa9a98-dcf8-4a4d-a21b-3aed4a873882 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:48.806795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa9a98-dcf8-4a4d-a21b-3aed4a873882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:48.808159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa9a98-dcf8-4a4d-a21b-3aed4a873882 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:48.810033 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:48.813855 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 399/768] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Sep 3 21:14:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:48.819859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e878d-7ba8-480c-9c90-a6d0befe288b None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:48.849188 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:48.922260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e878d-7ba8-480c-9c90-a6d0befe288b None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:48.956651 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32febf8c-e598-48ae-aea7-8a7243ee0e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:48.957290 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32febf8c-e598-48ae-aea7-8a7243ee0e9b None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:48.957568 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32febf8c-e598-48ae-aea7-8a7243ee0e9b None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:48.957840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32febf8c-e598-48ae-aea7-8a7243ee0e9b None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:48.958482 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32febf8c-e598-48ae-aea7-8a7243ee0e9b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:48.958780 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32febf8c-e598-48ae-aea7-8a7243ee0e9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:48.960167 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32febf8c-e598-48ae-aea7-8a7243ee0e9b None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:48.965794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 370/769] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Sep 3 21:14:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:48.972612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa9a98-dcf8-4a4d-a21b-3aed4a873882 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:49.080277 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa9a98-dcf8-4a4d-a21b-3aed4a873882 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:49.114176 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266bc6b-c99d-45d5-8c23-193860ec9c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:49.114855 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266bc6b-c99d-45d5-8c23-193860ec9c93 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:49.115038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266bc6b-c99d-45d5-8c23-193860ec9c93 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:49.115304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266bc6b-c99d-45d5-8c23-193860ec9c93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:49.115987 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266bc6b-c99d-45d5-8c23-193860ec9c93 None admin] RBAC: Adding query filter params (interface=public, service_id=4371b389abb64cf7afcf11545f6d2d95, region_id=RegionOne) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:49.116296 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266bc6b-c99d-45d5-8c23-193860ec9c93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:49.117708 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266bc6b-c99d-45d5-8c23-193860ec9c93 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:49.123273 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 400/770] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Sep 3 21:14:48 2022] GET /identity/v3/endpoints?service_id=4371b389abb64cf7afcf11545f6d2d95&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:49.128843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32febf8c-e598-48ae-aea7-8a7243ee0e9b None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:49.182956 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa91606-6c57-42d1-bffd-b8c800db04b8 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:49.183471 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa91606-6c57-42d1-bffd-b8c800db04b8 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:49.184246 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa91606-6c57-42d1-bffd-b8c800db04b8 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:49.185640 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 401/771] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:14:49.191368 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30818c23-cb24-4055-8c34-6486fe4e5668 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:49.191649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30818c23-cb24-4055-8c34-6486fe4e5668 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:49.191915 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30818c23-cb24-4055-8c34-6486fe4e5668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:49.209849 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-30818c23-cb24-4055-8c34-6486fe4e5668 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:49.211123 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-30818c23-cb24-4055-8c34-6486fe4e5668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:49.221909 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:49.231992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32febf8c-e598-48ae-aea7-8a7243ee0e9b None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:49.267238 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704c67b-0d6d-4a06-af6e-ea4e120ae1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:49.267238 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704c67b-0d6d-4a06-af6e-ea4e120ae1d7 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:49.267238 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704c67b-0d6d-4a06-af6e-ea4e120ae1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:49.267238 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704c67b-0d6d-4a06-af6e-ea4e120ae1d7 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:49.269929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704c67b-0d6d-4a06-af6e-ea4e120ae1d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:49.269929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704c67b-0d6d-4a06-af6e-ea4e120ae1d7 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:49.271297 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:49.276184 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 371/772] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Sep 3 21:14:49 2022] GET /identity/v3/services => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 21:14:49.286987 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 402/773] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:49 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 21:14:49.625851 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704c67b-0d6d-4a06-af6e-ea4e120ae1d7 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:49.737262 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704c67b-0d6d-4a06-af6e-ea4e120ae1d7 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:49.776983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c77c5-7ee9-4dce-81b4-76a107476b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:49.778167 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c77c5-7ee9-4dce-81b4-76a107476b4c None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:49.778449 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c77c5-7ee9-4dce-81b4-76a107476b4c None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:49.778721 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c77c5-7ee9-4dce-81b4-76a107476b4c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:49.779379 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c77c5-7ee9-4dce-81b4-76a107476b4c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:49.781001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c77c5-7ee9-4dce-81b4-76a107476b4c None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-a40c77c5-7ee9-4dce-81b4-76a107476b4c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:49.790777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:49.794770 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:49.795782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 372/774] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:14:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:49.798920 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30818c23-cb24-4055-8c34-6486fe4e5668 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:49.908871 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30818c23-cb24-4055-8c34-6486fe4e5668 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:49.942669 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f02097-efed-4b5e-a967-871dc4c814c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:49.943274 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f02097-efed-4b5e-a967-871dc4c814c5 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:49.943549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f02097-efed-4b5e-a967-871dc4c814c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:49.943816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f02097-efed-4b5e-a967-871dc4c814c5 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:49.944431 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f02097-efed-4b5e-a967-871dc4c814c5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:49.944760 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f02097-efed-4b5e-a967-871dc4c814c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:49.946292 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f02097-efed-4b5e-a967-871dc4c814c5 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:49.952296 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 403/775] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:14:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:49.958092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c77c5-7ee9-4dce-81b4-76a107476b4c None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:49.979271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:50.063127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c77c5-7ee9-4dce-81b4-76a107476b4c None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:50.102509 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905f3c8-0029-4a32-93d5-0fee1230f85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:50.103112 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905f3c8-0029-4a32-93d5-0fee1230f85f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:50.103391 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905f3c8-0029-4a32-93d5-0fee1230f85f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:50.103661 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905f3c8-0029-4a32-93d5-0fee1230f85f None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:50.104290 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905f3c8-0029-4a32-93d5-0fee1230f85f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:50.104622 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905f3c8-0029-4a32-93d5-0fee1230f85f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:50.106473 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905f3c8-0029-4a32-93d5-0fee1230f85f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:50.111409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 373/776] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:14:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:50.118149 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f02097-efed-4b5e-a967-871dc4c814c5 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:50.190911 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:50.237120 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f02097-efed-4b5e-a967-871dc4c814c5 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:50.281434 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdceba4f-f17d-4f6f-844a-86921cd493bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:50.282035 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdceba4f-f17d-4f6f-844a-86921cd493bf None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:50.282330 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdceba4f-f17d-4f6f-844a-86921cd493bf None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:50.282604 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdceba4f-f17d-4f6f-844a-86921cd493bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:50.283304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdceba4f-f17d-4f6f-844a-86921cd493bf None admin] RBAC: Adding query filter params (interface=public, service_id=c44a7762db794b2ba1c255f22a924800, region_id=RegionOne) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:50.283613 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdceba4f-f17d-4f6f-844a-86921cd493bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:50.285022 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdceba4f-f17d-4f6f-844a-86921cd493bf None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:50.290279 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 404/777] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Sep 3 21:14:50 2022] GET /identity/v3/endpoints?service_id=c44a7762db794b2ba1c255f22a924800&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:50.296746 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905f3c8-0029-4a32-93d5-0fee1230f85f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:50.384910 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:50.404680 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905f3c8-0029-4a32-93d5-0fee1230f85f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:50.446598 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cc3a6-7843-448d-9437-b477e12cbabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:50.447117 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cc3a6-7843-448d-9437-b477e12cbabf None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:50.447395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cc3a6-7843-448d-9437-b477e12cbabf None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:50.447665 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cc3a6-7843-448d-9437-b477e12cbabf None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:50.448260 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61cc3a6-7843-448d-9437-b477e12cbabf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:50.449952 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61cc3a6-7843-448d-9437-b477e12cbabf None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:50.455880 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 374/778] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Sep 3 21:14:50 2022] GET /identity/v3/services => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 21:14:51.513540 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e8912-59fa-4350-ab3a-8c9ebceddd6d None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:51.514342 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e8912-59fa-4350-ab3a-8c9ebceddd6d None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:51.514342 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e8912-59fa-4350-ab3a-8c9ebceddd6d None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:51.515389 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 405/779] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:51.521187 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cde206-24c5-406e-925a-ef049f40c682 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:51.521683 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cde206-24c5-406e-925a-ef049f40c682 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:51.521777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cde206-24c5-406e-925a-ef049f40c682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:51.541306 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-13cde206-24c5-406e-925a-ef049f40c682 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:51.542509 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-13cde206-24c5-406e-925a-ef049f40c682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:51.617576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 375/780] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:51 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:14:51.959470 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e8912-59fa-4350-ab3a-8c9ebceddd6d None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:52.076433 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e8912-59fa-4350-ab3a-8c9ebceddd6d None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:52.101287 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:52.116573 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86954b7-73a8-4a7b-b39b-ad0e9bcb7b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:52.117214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86954b7-73a8-4a7b-b39b-ad0e9bcb7b75 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:52.117489 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86954b7-73a8-4a7b-b39b-ad0e9bcb7b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:52.117753 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86954b7-73a8-4a7b-b39b-ad0e9bcb7b75 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:52.118327 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86954b7-73a8-4a7b-b39b-ad0e9bcb7b75 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:52.119692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86954b7-73a8-4a7b-b39b-ad0e9bcb7b75 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-f86954b7-73a8-4a7b-b39b-ad0e9bcb7b75 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:52.129576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:52.130776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:52.133623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 406/781] 10.222.0.43 () {56 vars in 1132 bytes} [Sat Sep 3 21:14:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:52.139538 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cde206-24c5-406e-925a-ef049f40c682 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:52.222042 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:52.245470 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cde206-24c5-406e-925a-ef049f40c682 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:52.284103 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ed2d2-0f3b-420a-9a20-75e180f2c3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:52.284747 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ed2d2-0f3b-420a-9a20-75e180f2c3b1 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:52.285023 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ed2d2-0f3b-420a-9a20-75e180f2c3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:52.285293 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ed2d2-0f3b-420a-9a20-75e180f2c3b1 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:52.286245 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ed2d2-0f3b-420a-9a20-75e180f2c3b1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:52.286667 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ed2d2-0f3b-420a-9a20-75e180f2c3b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:52.288136 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ed2d2-0f3b-420a-9a20-75e180f2c3b1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:52.293995 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 376/782] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Sep 3 21:14:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:52.299507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86954b7-73a8-4a7b-b39b-ad0e9bcb7b75 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:52.406352 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86954b7-73a8-4a7b-b39b-ad0e9bcb7b75 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:52.441138 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba89f0-a3af-421b-a8bf-e83501295869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:52.441751 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba89f0-a3af-421b-a8bf-e83501295869 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:52.442025 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba89f0-a3af-421b-a8bf-e83501295869 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:52.442294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba89f0-a3af-421b-a8bf-e83501295869 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:52.442910 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba89f0-a3af-421b-a8bf-e83501295869 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:52.443209 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba89f0-a3af-421b-a8bf-e83501295869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:52.444587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba89f0-a3af-421b-a8bf-e83501295869 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:52.450062 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 407/783] 10.222.0.43 () {56 vars in 1126 bytes} [Sat Sep 3 21:14:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:52.456037 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ed2d2-0f3b-420a-9a20-75e180f2c3b1 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:52.568984 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ed2d2-0f3b-420a-9a20-75e180f2c3b1 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:52.605109 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f1f92-1f98-4678-a689-c925986f6e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:52.606281 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f1f92-1f98-4678-a689-c925986f6e5a None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:52.606561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f1f92-1f98-4678-a689-c925986f6e5a None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:52.606939 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f1f92-1f98-4678-a689-c925986f6e5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:52.607962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f1f92-1f98-4678-a689-c925986f6e5a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:52.609516 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f1f92-1f98-4678-a689-c925986f6e5a None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:52.619039 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:52.695308 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e5f52-4f67-43e8-b021-bd92c8931890 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:52.695860 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e5f52-4f67-43e8-b021-bd92c8931890 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:52.695860 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e5f52-4f67-43e8-b021-bd92c8931890 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:52.697245 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 408/784] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:14:52.701980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e21e3-d642-418f-8957-6c107bacc0d5 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:52.702258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e21e3-d642-418f-8957-6c107bacc0d5 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:52.702527 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e21e3-d642-418f-8957-6c107bacc0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:52.721819 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-9f3e21e3-d642-418f-8957-6c107bacc0d5 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:52.723031 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-9f3e21e3-d642-418f-8957-6c107bacc0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:52.724921 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 377/785] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Sep 3 21:14:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:14:52.779058 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:52.814190 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 409/786] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:52 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 21:14:53.151947 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f1f92-1f98-4678-a689-c925986f6e5a None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:53.255558 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f1f92-1f98-4678-a689-c925986f6e5a None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:53.291351 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d9cae-3d09-49c2-8336-aaccb994d86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:53.291889 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d9cae-3d09-49c2-8336-aaccb994d86c None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:53.292165 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d9cae-3d09-49c2-8336-aaccb994d86c None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:53.292436 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d9cae-3d09-49c2-8336-aaccb994d86c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:53.293607 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d9cae-3d09-49c2-8336-aaccb994d86c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:53.295056 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d9cae-3d09-49c2-8336-aaccb994d86c None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-fb1d9cae-3d09-49c2-8336-aaccb994d86c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:53.304119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:53.305409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:53.306278 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 378/787] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:14:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:53.312268 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e21e3-d642-418f-8957-6c107bacc0d5 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:53.413275 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e21e3-d642-418f-8957-6c107bacc0d5 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:53.448610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d633b-1560-4b78-8b88-5df61cf3c476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:53.449243 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d633b-1560-4b78-8b88-5df61cf3c476 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:53.449527 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d633b-1560-4b78-8b88-5df61cf3c476 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:53.449799 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d633b-1560-4b78-8b88-5df61cf3c476 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:53.450410 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d633b-1560-4b78-8b88-5df61cf3c476 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:53.450711 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d633b-1560-4b78-8b88-5df61cf3c476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:53.452168 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d633b-1560-4b78-8b88-5df61cf3c476 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:53.457907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 410/788] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:14:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:53.464161 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d9cae-3d09-49c2-8336-aaccb994d86c None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:53.528331 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:53.570666 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d9cae-3d09-49c2-8336-aaccb994d86c None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:53.605168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6891763-d8aa-4667-bceb-117af16ce1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:53.606328 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6891763-d8aa-4667-bceb-117af16ce1e7 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:53.606777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6891763-d8aa-4667-bceb-117af16ce1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:53.607053 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6891763-d8aa-4667-bceb-117af16ce1e7 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:53.607672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6891763-d8aa-4667-bceb-117af16ce1e7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:53.608068 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6891763-d8aa-4667-bceb-117af16ce1e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:53.609500 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6891763-d8aa-4667-bceb-117af16ce1e7 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:53.614747 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 379/789] 10.222.0.43 () {56 vars in 1114 bytes} [Sat Sep 3 21:14:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:53.620876 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d633b-1560-4b78-8b88-5df61cf3c476 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:53.669151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:53.728829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d633b-1560-4b78-8b88-5df61cf3c476 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:53.767184 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf12e6-0eaa-45fe-8ade-3eb4b5a618fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:53.767883 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf12e6-0eaa-45fe-8ade-3eb4b5a618fd None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:53.768162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf12e6-0eaa-45fe-8ade-3eb4b5a618fd None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:53.768432 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf12e6-0eaa-45fe-8ade-3eb4b5a618fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:53.769132 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf12e6-0eaa-45fe-8ade-3eb4b5a618fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:53.770488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf12e6-0eaa-45fe-8ade-3eb4b5a618fd None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:53.880238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 411/790] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Sep 3 21:14:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:14:54.966754 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b653c85-6427-4d7a-9cfb-6daae3c5d183 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:54.967321 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b653c85-6427-4d7a-9cfb-6daae3c5d183 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:54.967321 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b653c85-6427-4d7a-9cfb-6daae3c5d183 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:54.968792 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 380/791] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:54.974684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cb370-37cb-472f-8bce-3747720bb9de None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:54.975150 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cb370-37cb-472f-8bce-3747720bb9de None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:54.975332 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cb370-37cb-472f-8bce-3747720bb9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:54.993672 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-066cb370-37cb-472f-8bce-3747720bb9de None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:54.994851 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-066cb370-37cb-472f-8bce-3747720bb9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:55.071162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 412/792] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:54 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:14:55.401958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b653c85-6427-4d7a-9cfb-6daae3c5d183 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:55.511386 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b653c85-6427-4d7a-9cfb-6daae3c5d183 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:55.537011 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:55.548360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e004738-a265-4f7a-bb1c-2fd4e63898a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:55.549046 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e004738-a265-4f7a-bb1c-2fd4e63898a7 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:55.549369 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e004738-a265-4f7a-bb1c-2fd4e63898a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:55.549661 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e004738-a265-4f7a-bb1c-2fd4e63898a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:55.550294 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e004738-a265-4f7a-bb1c-2fd4e63898a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:55.551659 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e004738-a265-4f7a-bb1c-2fd4e63898a7 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-2e004738-a265-4f7a-bb1c-2fd4e63898a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:55.561344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:55.562464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:55.563421 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 381/793] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:55.569205 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cb370-37cb-472f-8bce-3747720bb9de None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:55.592168 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:55.677944 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cb370-37cb-472f-8bce-3747720bb9de None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:55.713247 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc8c46-dd1e-4e86-8225-8de18ea0419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:55.713851 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc8c46-dd1e-4e86-8225-8de18ea0419b None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:55.714132 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc8c46-dd1e-4e86-8225-8de18ea0419b None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:55.714406 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc8c46-dd1e-4e86-8225-8de18ea0419b None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:55.715708 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc8c46-dd1e-4e86-8225-8de18ea0419b None admin] RBAC: Adding query filter params (name=compute) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:55.716199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc8c46-dd1e-4e86-8225-8de18ea0419b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:55.717715 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc8c46-dd1e-4e86-8225-8de18ea0419b None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:55.723018 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 413/794] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Sep 3 21:14:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:55.730288 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e004738-a265-4f7a-bb1c-2fd4e63898a7 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:55.838330 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e004738-a265-4f7a-bb1c-2fd4e63898a7 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:55.874382 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42eb55a-33bc-4951-99ac-3eb539713881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:55.874978 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eb55a-33bc-4951-99ac-3eb539713881 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:55.875254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eb55a-33bc-4951-99ac-3eb539713881 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:55.875527 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42eb55a-33bc-4951-99ac-3eb539713881 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:55.876150 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eb55a-33bc-4951-99ac-3eb539713881 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:55.876448 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eb55a-33bc-4951-99ac-3eb539713881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:55.877852 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42eb55a-33bc-4951-99ac-3eb539713881 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:55.890444 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 382/795] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Sep 3 21:14:55 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:56.180781 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db38276-4d3c-4922-90b6-bcb861ab0757 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:56.181338 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db38276-4d3c-4922-90b6-bcb861ab0757 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:56.181338 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db38276-4d3c-4922-90b6-bcb861ab0757 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:56.182812 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 414/796] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:56.188377 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c740ad9-dcc9-4a15-9f63-849e608474db None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:56.188874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c740ad9-dcc9-4a15-9f63-849e608474db None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:56.188989 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c740ad9-dcc9-4a15-9f63-849e608474db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:56.208659 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-7c740ad9-dcc9-4a15-9f63-849e608474db None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:56.209849 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-7c740ad9-dcc9-4a15-9f63-849e608474db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:56.264392 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:56.287443 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 383/797] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:56 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:14:56.622456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db38276-4d3c-4922-90b6-bcb861ab0757 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:56.718163 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:56.736736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db38276-4d3c-4922-90b6-bcb861ab0757 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:56.772963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69814316-fff6-4e31-9915-575c98fe937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:56.773666 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814316-fff6-4e31-9915-575c98fe937a None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:56.774155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814316-fff6-4e31-9915-575c98fe937a None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:56.774458 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814316-fff6-4e31-9915-575c98fe937a None admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:56.775098 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69814316-fff6-4e31-9915-575c98fe937a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:56.776550 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69814316-fff6-4e31-9915-575c98fe937a None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:56.779329 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: WARNING keystone.server.flask.common [None req-69814316-fff6-4e31-9915-575c98fe937a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 03 21:14:56.838158 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.sql.core [None req-69814316-fff6-4e31-9915-575c98fe937a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 03 21:14:56.838158 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 03 21:14:56.838158 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [parameters: {'id': 'bb7a2c8b1cd44143acd7fc1e7121096b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 03 21:14:56.838158 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 03 21:14:56.855295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-69814316-fff6-4e31-9915-575c98fe937a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb7a2c8b1cd44143acd7fc1e7121096b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb7a2c8b1cd44143acd7fc1e7121096b. Sep 03 21:14:56.855295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:56.855295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 21:14:56.855295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 21:14:56.855295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 21:14:56.855295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 21:14:56.855295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 21:14:56.855295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 21:14:56.855295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 21:14:56.855295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application conn.query(q) Sep 03 21:14:56.855295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 21:14:56.855295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 21:14:56.855295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application result.read() Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 03 21:14:56.857038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application next(self.gen) Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application yield resource Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application next(self.gen) Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self.session.rollback() Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self.force_reraise() Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise self.value Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application session.commit() Sep 03 21:14:56.858072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._prepare_impl() Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self.session.flush() Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._flush(objects) Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application compat.raise_( Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application flush_context.execute() Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 03 21:14:56.859233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rec.execute(self) Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 03 21:14:56.860374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application conn.query(q) Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application result.read() Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 21:14:56.861465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [parameters: {'id': 'bb7a2c8b1cd44143acd7fc1e7121096b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:56.862563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:56.866784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:56.867910 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:56.867910 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 03 21:14:56.867910 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 03 21:14:56.867910 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:56.867910 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:56.867910 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 03 21:14:56.867910 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 03 21:14:56.867910 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bb7a2c8b1cd44143acd7fc1e7121096b. Sep 03 21:14:56.867910 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:14:56.867910 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 415/798] 10.222.0.43 () {60 vars in 1140 bytes} [Sat Sep 3 21:14:56 2022] POST /identity/v3/projects => generated 262 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:56.868596 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c740ad9-dcc9-4a15-9f63-849e608474db None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:56.978923 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c740ad9-dcc9-4a15-9f63-849e608474db None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:57.142696 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc157ce6-4797-4bec-a9ce-b9d173d97e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:57.143329 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc157ce6-4797-4bec-a9ce-b9d173d97e0d None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:57.143603 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc157ce6-4797-4bec-a9ce-b9d173d97e0d None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:57.143869 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc157ce6-4797-4bec-a9ce-b9d173d97e0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:57.151060 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc157ce6-4797-4bec-a9ce-b9d173d97e0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:57.153067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc157ce6-4797-4bec-a9ce-b9d173d97e0d None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-cc157ce6-4797-4bec-a9ce-b9d173d97e0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:14:57.165402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:14:57.172694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:14:57.173715 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:14:57.173715 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:14:57.173715 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:14:57.173715 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:14:57.173715 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:14:57.173715 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:14:57.173715 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:14:57.173715 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:14:57.173715 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 384/799] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:14:57.174239 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69814316-fff6-4e31-9915-575c98fe937a None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:57.286699 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69814316-fff6-4e31-9915-575c98fe937a None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:57.322680 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d65cb-62c4-428c-9ab9-2a3fa0541530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:57.323290 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d65cb-62c4-428c-9ab9-2a3fa0541530 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:57.323572 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d65cb-62c4-428c-9ab9-2a3fa0541530 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:57.323845 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d65cb-62c4-428c-9ab9-2a3fa0541530 None admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:57.325856 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d65cb-62c4-428c-9ab9-2a3fa0541530 None admin] RBAC: Adding query filter params (name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:14:57.326162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d65cb-62c4-428c-9ab9-2a3fa0541530 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:57.327838 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d65cb-62c4-428c-9ab9-2a3fa0541530 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:57.343075 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:57.360552 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 416/800] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Sep 3 21:14:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:14:58.130342 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29106093-62c2-4535-b846-cf3cb52c1c47 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:58.130906 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29106093-62c2-4535-b846-cf3cb52c1c47 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:58.130906 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29106093-62c2-4535-b846-cf3cb52c1c47 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:58.132205 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 385/801] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:58.137958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c3602-0bc9-48d3-85cc-344f0b283fb5 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:58.138251 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c3602-0bc9-48d3-85cc-344f0b283fb5 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:58.138607 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c3602-0bc9-48d3-85cc-344f0b283fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:58.160196 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-f19c3602-0bc9-48d3-85cc-344f0b283fb5 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:58.161726 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-f19c3602-0bc9-48d3-85cc-344f0b283fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:58.230440 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 417/802] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:58 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:14:58.565048 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29106093-62c2-4535-b846-cf3cb52c1c47 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:14:58.613058 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:14:58.670342 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29106093-62c2-4535-b846-cf3cb52c1c47 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:14:58.703187 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ea53e-028b-42d7-afd6-7e21d5e793a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:14:58.703787 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ea53e-028b-42d7-afd6-7e21d5e793a3 None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:58.704064 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ea53e-028b-42d7-afd6-7e21d5e793a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:58.704334 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ea53e-028b-42d7-afd6-7e21d5e793a3 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:58.705031 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ea53e-028b-42d7-afd6-7e21d5e793a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:14:58.706451 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ea53e-028b-42d7-afd6-7e21d5e793a3 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:14:58.799509 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 386/803] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Sep 3 21:14:58 2022] POST /identity/v3/services => generated 242 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:14:59.620317 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2100178-77b8-41c0-ae6e-cc37e30956c6 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:59.620904 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2100178-77b8-41c0-ae6e-cc37e30956c6 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:59.620904 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2100178-77b8-41c0-ae6e-cc37e30956c6 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:59.622248 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 418/804] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:14:59.627362 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf3d56-84f9-4c43-adf2-c5766ac474b8 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:14:59.627788 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf3d56-84f9-4c43-adf2-c5766ac474b8 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:14:59.627901 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf3d56-84f9-4c43-adf2-c5766ac474b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:14:59.646022 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-a1bf3d56-84f9-4c43-adf2-c5766ac474b8 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:14:59.647195 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-a1bf3d56-84f9-4c43-adf2-c5766ac474b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:14:59.721620 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 387/805] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:14:59 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:15:00.057133 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2100178-77b8-41c0-ae6e-cc37e30956c6 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:15:00.165610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2100178-77b8-41c0-ae6e-cc37e30956c6 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:15:00.195941 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:00.202065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd3d18-59e3-4c76-904b-99e838368fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:15:00.202710 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd3d18-59e3-4c76-904b-99e838368fdd None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:00.202986 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd3d18-59e3-4c76-904b-99e838368fdd None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:00.203256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd3d18-59e3-4c76-904b-99e838368fdd None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:00.203891 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd3d18-59e3-4c76-904b-99e838368fdd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:15:00.205349 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd3d18-59e3-4c76-904b-99e838368fdd None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:15:00.295542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.sql.core [None req-24cd3d18-59e3-4c76-904b-99e838368fdd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 03 21:15:00.295542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 03 21:15:00.295542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [parameters: {'user_id': '2d841f14d3ce4dcb8584dbe799cac726', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 03 21:15:00.295542 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88385) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-24cd3d18-59e3-4c76-904b-99e838368fdd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application conn.query(q) Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application result.read() Sep 03 21:15:00.302745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 21:15:00.303694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application next(self.gen) Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application yield resource Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application next(self.gen) Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self.session.rollback() Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self.force_reraise() Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise self.value Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application session.commit() Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 03 21:15:00.304886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._prepare_impl() Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self.session.flush() Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._flush(objects) Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application compat.raise_( Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application flush_context.execute() Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rec.execute(self) Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 03 21:15:00.306014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 03 21:15:00.306917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application result = self._query(query) Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application conn.query(q) Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application result.read() Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 03 21:15:00.307732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [parameters: {'user_id': '2d841f14d3ce4dcb8584dbe799cac726', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:15:00.308587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 03 21:15:00.310112 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 03 21:15:00.311256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 03 21:15:00.311256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 03 21:15:00.311256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 03 21:15:00.311256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 03 21:15:00.311256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 03 21:15:00.311256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:15:00.311256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 419/806] 10.222.0.43 () {60 vars in 1131 bytes} [Sat Sep 3 21:15:00 2022] POST /identity/v3/users => generated 160 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:15:00.312861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf3d56-84f9-4c43-adf2-c5766ac474b8 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:15:00.342184 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:00.423498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf3d56-84f9-4c43-adf2-c5766ac474b8 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:15:00.459791 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae9452-aaea-4667-8062-1e7ac12afd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:15:00.460419 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae9452-aaea-4667-8062-1e7ac12afd92 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:00.460730 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae9452-aaea-4667-8062-1e7ac12afd92 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:00.460995 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae9452-aaea-4667-8062-1e7ac12afd92 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:00.469231 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae9452-aaea-4667-8062-1e7ac12afd92 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:15:00.470695 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae9452-aaea-4667-8062-1e7ac12afd92 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-24ae9452-aaea-4667-8062-1e7ac12afd92 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:15:00.483708 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:15:00.484859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:15:00.485840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:15:00.485840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:15:00.485840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:15:00.485840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:15:00.485840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:15:00.485840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:15:00.485840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:15:00.485840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:15:00.485840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 03 21:15:00.485840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:15:00.485840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 388/807] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:15:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:15:00.490983 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd3d18-59e3-4c76-904b-99e838368fdd None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:15:00.596813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd3d18-59e3-4c76-904b-99e838368fdd None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:15:00.633844 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc449e9-401f-4fa2-8415-deb54a0bb691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:15:00.634506 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc449e9-401f-4fa2-8415-deb54a0bb691 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:00.634718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc449e9-401f-4fa2-8415-deb54a0bb691 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:00.635028 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc449e9-401f-4fa2-8415-deb54a0bb691 None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:00.635782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc449e9-401f-4fa2-8415-deb54a0bb691 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:15:00.636050 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc449e9-401f-4fa2-8415-deb54a0bb691 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:15:00.638407 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc449e9-401f-4fa2-8415-deb54a0bb691 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:15:00.678960 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 420/808] 10.222.0.43 () {56 vars in 1101 bytes} [Sat Sep 3 21:15:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:15:01.130466 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811dcfe-68db-44d1-bcad-b4490ca4620b None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:01.130966 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811dcfe-68db-44d1-bcad-b4490ca4620b None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:01.130966 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811dcfe-68db-44d1-bcad-b4490ca4620b None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:01.132251 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 389/809] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:15:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:15:01.138633 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c72903-8c9b-4284-8694-3bdce5b027bf None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:01.138973 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c72903-8c9b-4284-8694-3bdce5b027bf None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:01.139273 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c72903-8c9b-4284-8694-3bdce5b027bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:01.158183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-33c72903-8c9b-4284-8694-3bdce5b027bf None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:15:01.159749 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-33c72903-8c9b-4284-8694-3bdce5b027bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:15:01.207811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:01.227972 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 421/810] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:15:01 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:15:01.556302 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811dcfe-68db-44d1-bcad-b4490ca4620b None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:15:01.646521 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:01.659957 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811dcfe-68db-44d1-bcad-b4490ca4620b None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:15:01.696655 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576c7d-fec2-4486-b32a-f90b8d3d14c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:15:01.697303 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576c7d-fec2-4486-b32a-f90b8d3d14c7 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:01.697579 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576c7d-fec2-4486-b32a-f90b8d3d14c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:01.697847 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6576c7d-fec2-4486-b32a-f90b8d3d14c7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:01.698436 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6576c7d-fec2-4486-b32a-f90b8d3d14c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:15:01.700159 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6576c7d-fec2-4486-b32a-f90b8d3d14c7 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-e6576c7d-fec2-4486-b32a-f90b8d3d14c7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:15:01.709848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:15:01.711145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:15:01.712311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 390/811] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:15:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 03 21:15:01.717909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c72903-8c9b-4284-8694-3bdce5b027bf None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:15:01.827094 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c72903-8c9b-4284-8694-3bdce5b027bf None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:15:01.864036 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea55de0-baae-4632-937b-31a18bd0ee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:15:01.864673 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea55de0-baae-4632-937b-31a18bd0ee76 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:01.864958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea55de0-baae-4632-937b-31a18bd0ee76 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:01.865235 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea55de0-baae-4632-937b-31a18bd0ee76 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:01.865883 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea55de0-baae-4632-937b-31a18bd0ee76 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:15:01.866204 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea55de0-baae-4632-937b-31a18bd0ee76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:15:01.867580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea55de0-baae-4632-937b-31a18bd0ee76 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:15:01.872655 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 422/812] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Sep 3 21:15:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:15:01.878668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576c7d-fec2-4486-b32a-f90b8d3d14c7 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:15:01.980560 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6576c7d-fec2-4486-b32a-f90b8d3d14c7 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:15:02.015439 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6033ba-6eae-4ebb-bbb4-7719c5d673bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:15:02.015932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6033ba-6eae-4ebb-bbb4-7719c5d673bc None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:02.016213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6033ba-6eae-4ebb-bbb4-7719c5d673bc None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:02.016485 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6033ba-6eae-4ebb-bbb4-7719c5d673bc None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:02.017147 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6033ba-6eae-4ebb-bbb4-7719c5d673bc None admin] RBAC: Adding query filter params (type=compute) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:15:02.017454 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6033ba-6eae-4ebb-bbb4-7719c5d673bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:15:02.018830 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6033ba-6eae-4ebb-bbb4-7719c5d673bc None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:15:02.024342 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 391/813] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Sep 3 21:15:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:15:02.031432 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea55de0-baae-4632-937b-31a18bd0ee76 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:15:02.078330 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:02.135425 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea55de0-baae-4632-937b-31a18bd0ee76 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:15:02.171044 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da193fdb-e128-4f12-b489-21932f167696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:15:02.171662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da193fdb-e128-4f12-b489-21932f167696 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:02.171941 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da193fdb-e128-4f12-b489-21932f167696 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:02.172213 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da193fdb-e128-4f12-b489-21932f167696 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:02.172940 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da193fdb-e128-4f12-b489-21932f167696 None admin] RBAC: Adding query filter params (interface=public, service_id=32bc30d8f69f4520bfe46ce9e2cf8fc9, region_id=RegionOne) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:15:02.173252 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da193fdb-e128-4f12-b489-21932f167696 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:15:02.174719 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da193fdb-e128-4f12-b489-21932f167696 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:15:02.179883 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 423/814] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Sep 3 21:15:02 2022] GET /identity/v3/endpoints?service_id=32bc30d8f69f4520bfe46ce9e2cf8fc9&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:15:02.186028 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6033ba-6eae-4ebb-bbb4-7719c5d673bc None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:15:02.205291 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:02.287115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6033ba-6eae-4ebb-bbb4-7719c5d673bc None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:15:02.320441 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4164f-8eb3-4c63-a687-22f92b2be840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:15:02.321067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4164f-8eb3-4c63-a687-22f92b2be840 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:02.321343 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4164f-8eb3-4c63-a687-22f92b2be840 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:02.321612 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4164f-8eb3-4c63-a687-22f92b2be840 None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:02.322196 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4164f-8eb3-4c63-a687-22f92b2be840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:15:02.323561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4164f-8eb3-4c63-a687-22f92b2be840 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:15:02.330331 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 392/815] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Sep 3 21:15:02 2022] GET /identity/v3/services => generated 1728 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 21:15:04.534769 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74e6d3-a0fe-4778-ae43-6b71f94019a7 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:04.535309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74e6d3-a0fe-4778-ae43-6b71f94019a7 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:04.535309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74e6d3-a0fe-4778-ae43-6b71f94019a7 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:04.536663 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 424/816] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:15:04.542052 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d0b3a-1464-4442-973d-56def595a9c3 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:04.542510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d0b3a-1464-4442-973d-56def595a9c3 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:04.542602 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d0b3a-1464-4442-973d-56def595a9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:04.562185 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-978d0b3a-1464-4442-973d-56def595a9c3 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:15:04.563373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-978d0b3a-1464-4442-973d-56def595a9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:15:04.632731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 393/817] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:15:04 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 21:15:04.978347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74e6d3-a0fe-4778-ae43-6b71f94019a7 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:15:05.086311 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74e6d3-a0fe-4778-ae43-6b71f94019a7 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:15:05.097620 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:05.122778 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301979cd-32dd-4088-acb1-f0b43543681f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:15:05.123403 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301979cd-32dd-4088-acb1-f0b43543681f None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:05.123685 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301979cd-32dd-4088-acb1-f0b43543681f None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:05.123959 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301979cd-32dd-4088-acb1-f0b43543681f None admin] PATH_INFO: `/v3/services/compute` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:05.124571 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301979cd-32dd-4088-acb1-f0b43543681f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:15:05.125948 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301979cd-32dd-4088-acb1-f0b43543681f None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-301979cd-32dd-4088-acb1-f0b43543681f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:15:05.134839 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:15:05.136347 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:15:05.138321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 425/818] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:15:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:15:05.143580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d0b3a-1464-4442-973d-56def595a9c3 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:15:05.156352 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:05.251222 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d0b3a-1464-4442-973d-56def595a9c3 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:15:05.286202 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a351e-9086-4044-a052-9525902300bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:15:05.286800 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a351e-9086-4044-a052-9525902300bf None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:05.287072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a351e-9086-4044-a052-9525902300bf None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:05.287338 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a351e-9086-4044-a052-9525902300bf None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:05.287945 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a351e-9086-4044-a052-9525902300bf None admin] RBAC: Adding query filter params (name=compute) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:15:05.288240 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a351e-9086-4044-a052-9525902300bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:15:05.289703 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a351e-9086-4044-a052-9525902300bf None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:15:05.294535 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 394/819] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Sep 3 21:15:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:15:05.300554 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301979cd-32dd-4088-acb1-f0b43543681f None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:15:05.407545 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301979cd-32dd-4088-acb1-f0b43543681f None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:15:05.441727 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917492-3696-43f2-89b5-d2d4cb641f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:15:05.442329 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917492-3696-43f2-89b5-d2d4cb641f19 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:05.442604 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917492-3696-43f2-89b5-d2d4cb641f19 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:05.442907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917492-3696-43f2-89b5-d2d4cb641f19 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:05.443523 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5917492-3696-43f2-89b5-d2d4cb641f19 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:15:05.443823 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5917492-3696-43f2-89b5-d2d4cb641f19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:15:05.445210 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5917492-3696-43f2-89b5-d2d4cb641f19 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:15:05.450826 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 426/820] 10.222.0.43 () {56 vars in 1112 bytes} [Sat Sep 3 21:15:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:15:05.456895 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a351e-9086-4044-a052-9525902300bf None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:15:05.534871 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:05.560211 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a351e-9086-4044-a052-9525902300bf None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:15:05.596120 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb28a3-3bba-4c8f-84f0-f561fd1dd833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:15:05.596745 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb28a3-3bba-4c8f-84f0-f561fd1dd833 None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:15:05.597020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb28a3-3bba-4c8f-84f0-f561fd1dd833 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:15:05.597286 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb28a3-3bba-4c8f-84f0-f561fd1dd833 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:15:05.598025 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb28a3-3bba-4c8f-84f0-f561fd1dd833 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:15:05.599301 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb28a3-3bba-4c8f-84f0-f561fd1dd833 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:15:05.679093 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 395/821] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Sep 3 21:15:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:15:15.447585 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=82 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:15:15.674262 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=34,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:31.707028 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b428ac9-c3b0-4e5c-9708-2753f6451def None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:31.707622 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b428ac9-c3b0-4e5c-9708-2753f6451def None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:31.707622 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b428ac9-c3b0-4e5c-9708-2753f6451def None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:31.709019 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 427/822] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:16:31.715070 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6d0dc-70ac-4b01-850a-a4968c7b8bf4 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:31.715517 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6d0dc-70ac-4b01-850a-a4968c7b8bf4 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:31.715621 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6d0dc-70ac-4b01-850a-a4968c7b8bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:31.734273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-66a6d0dc-70ac-4b01-850a-a4968c7b8bf4 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:16:31.735442 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-66a6d0dc-70ac-4b01-850a-a4968c7b8bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:16:31.808092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 396/823] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:16:31 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:16:32.139472 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b428ac9-c3b0-4e5c-9708-2753f6451def None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:32.244727 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b428ac9-c3b0-4e5c-9708-2753f6451def None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:32.280186 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fad414-926b-4094-bd9c-cf9bab1874c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:32.280760 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fad414-926b-4094-bd9c-cf9bab1874c0 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:32.281042 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fad414-926b-4094-bd9c-cf9bab1874c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:32.281314 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fad414-926b-4094-bd9c-cf9bab1874c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:32.291935 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fad414-926b-4094-bd9c-cf9bab1874c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:32.297237 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fad414-926b-4094-bd9c-cf9bab1874c0 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-81fad414-926b-4094-bd9c-cf9bab1874c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:16:32.307660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:32.308912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:16:32.310111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:16:32.310111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:32.310111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:16:32.310111 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 428/824] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:32.315433 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6d0dc-70ac-4b01-850a-a4968c7b8bf4 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:32.417302 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6d0dc-70ac-4b01-850a-a4968c7b8bf4 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:32.444508 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:32.453922 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f918d8-154b-4722-b7dd-22b4fd720c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:32.456521 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f918d8-154b-4722-b7dd-22b4fd720c35 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:32.456521 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f918d8-154b-4722-b7dd-22b4fd720c35 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:32.456521 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f918d8-154b-4722-b7dd-22b4fd720c35 None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:32.456521 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f918d8-154b-4722-b7dd-22b4fd720c35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:32.456521 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f918d8-154b-4722-b7dd-22b4fd720c35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:32.457450 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f918d8-154b-4722-b7dd-22b4fd720c35 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:32.468583 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 397/825] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:32.474267 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fad414-926b-4094-bd9c-cf9bab1874c0 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:32.528086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:32.574948 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fad414-926b-4094-bd9c-cf9bab1874c0 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:32.607698 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefc4c5-1907-475a-a1d3-6ca6ec996bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:32.608293 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefc4c5-1907-475a-a1d3-6ca6ec996bc1 None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:32.608599 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefc4c5-1907-475a-a1d3-6ca6ec996bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:32.608872 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefc4c5-1907-475a-a1d3-6ca6ec996bc1 None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:32.609526 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefc4c5-1907-475a-a1d3-6ca6ec996bc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:32.610927 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefc4c5-1907-475a-a1d3-6ca6ec996bc1 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:32.779860 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 429/826] 10.222.0.43 () {60 vars in 1132 bytes} [Sat Sep 3 21:16:32 2022] POST /identity/v3/users => generated 251 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:16:35.019041 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ccf63-55ee-4ccc-ade9-b48c2c86c026 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:35.021675 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ccf63-55ee-4ccc-ade9-b48c2c86c026 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:35.021675 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515ccf63-55ee-4ccc-ade9-b48c2c86c026 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:35.021675 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 398/827] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:16:35.027217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643e43a-e699-4984-b0ec-241942de6950 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:35.027633 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643e43a-e699-4984-b0ec-241942de6950 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:35.027777 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643e43a-e699-4984-b0ec-241942de6950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:35.047406 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-5643e43a-e699-4984-b0ec-241942de6950 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:16:35.048639 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-5643e43a-e699-4984-b0ec-241942de6950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:16:35.121565 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 430/828] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:16:35 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 21:16:35.463676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ccf63-55ee-4ccc-ade9-b48c2c86c026 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:35.564424 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515ccf63-55ee-4ccc-ade9-b48c2c86c026 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:35.597419 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f13e6-281e-4dff-bdf7-e8721f62c00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:35.598038 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f13e6-281e-4dff-bdf7-e8721f62c00f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:35.598314 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f13e6-281e-4dff-bdf7-e8721f62c00f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:35.598582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f13e6-281e-4dff-bdf7-e8721f62c00f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:35.608932 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f13e6-281e-4dff-bdf7-e8721f62c00f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-1d6f13e6-281e-4dff-bdf7-e8721f62c00f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:16:35.613654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:35.620235 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:35.621863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:35.621863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:35.621863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:35.621863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:35.621863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:16:35.621863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:16:35.621863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:16:35.621863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:16:35.621863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:16:35.621863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:16:35.621863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:16:35.621863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:35.621863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 399/829] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:16:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:35.626307 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643e43a-e699-4984-b0ec-241942de6950 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:35.663684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:35.722277 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643e43a-e699-4984-b0ec-241942de6950 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:35.755909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c52bd-0187-41fd-9ff8-34834e98272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:35.756503 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c52bd-0187-41fd-9ff8-34834e98272c None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:35.756812 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c52bd-0187-41fd-9ff8-34834e98272c None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:35.757081 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c52bd-0187-41fd-9ff8-34834e98272c None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:35.757725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c52bd-0187-41fd-9ff8-34834e98272c None admin] RBAC: Adding query filter params (name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:35.758713 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c52bd-0187-41fd-9ff8-34834e98272c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:35.760162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c52bd-0187-41fd-9ff8-34834e98272c None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:35.768141 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 431/830] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:16:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:35.774301 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f13e6-281e-4dff-bdf7-e8721f62c00f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:35.821230 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:35.874858 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f13e6-281e-4dff-bdf7-e8721f62c00f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:35.907818 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec403f-7b2f-4af4-81fc-4dd6d1ccd995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:35.908401 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec403f-7b2f-4af4-81fc-4dd6d1ccd995 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:35.908705 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec403f-7b2f-4af4-81fc-4dd6d1ccd995 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:35.908974 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec403f-7b2f-4af4-81fc-4dd6d1ccd995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:35.919781 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec403f-7b2f-4af4-81fc-4dd6d1ccd995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:35.925100 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec403f-7b2f-4af4-81fc-4dd6d1ccd995 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-eeec403f-7b2f-4af4-81fc-4dd6d1ccd995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:16:35.935803 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:35.936918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:16:35.937854 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:16:35.937854 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:35.937854 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:35.937854 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 400/831] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:35.942786 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c52bd-0187-41fd-9ff8-34834e98272c None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:36.040677 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:36.043517 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c52bd-0187-41fd-9ff8-34834e98272c None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:36.077611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b098b5-838b-4277-b24a-ad6506e67b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:36.078217 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b098b5-838b-4277-b24a-ad6506e67b1f None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:36.078499 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b098b5-838b-4277-b24a-ad6506e67b1f None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:36.078772 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b098b5-838b-4277-b24a-ad6506e67b1f None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:36.079412 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b098b5-838b-4277-b24a-ad6506e67b1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:36.079714 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b098b5-838b-4277-b24a-ad6506e67b1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:36.081126 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b098b5-838b-4277-b24a-ad6506e67b1f None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:36.093221 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 432/832] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:16:36.099145 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec403f-7b2f-4af4-81fc-4dd6d1ccd995 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:36.196729 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:36.200556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec403f-7b2f-4af4-81fc-4dd6d1ccd995 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:36.234533 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a32a3a-4377-439a-8104-3301ebb352cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:36.235147 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a32a3a-4377-439a-8104-3301ebb352cc None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:36.235429 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a32a3a-4377-439a-8104-3301ebb352cc None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:36.235703 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a32a3a-4377-439a-8104-3301ebb352cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:36.242985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a32a3a-4377-439a-8104-3301ebb352cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:36.244420 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a32a3a-4377-439a-8104-3301ebb352cc None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-39a32a3a-4377-439a-8104-3301ebb352cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:16:36.255333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:36.256381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:36.257582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:36.257582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:36.257582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:16:36.257582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:16:36.257582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:16:36.257582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:16:36.257582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:16:36.257582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:16:36.257582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 21:16:36.257582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:36.257582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 401/833] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:36.262493 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b098b5-838b-4277-b24a-ad6506e67b1f None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:36.363281 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b098b5-838b-4277-b24a-ad6506e67b1f None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:36.399068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0f1ca-abea-4aff-9aa8-40b8af30ddb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:36.399679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0f1ca-abea-4aff-9aa8-40b8af30ddb4 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:36.399983 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0f1ca-abea-4aff-9aa8-40b8af30ddb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:36.400253 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0f1ca-abea-4aff-9aa8-40b8af30ddb4 None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:36.401010 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0f1ca-abea-4aff-9aa8-40b8af30ddb4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:36.401320 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0f1ca-abea-4aff-9aa8-40b8af30ddb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:36.403034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0f1ca-abea-4aff-9aa8-40b8af30ddb4 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:36.421046 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 433/834] 10.222.0.43 () {56 vars in 1143 bytes} [Sat Sep 3 21:16:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:36.426972 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a32a3a-4377-439a-8104-3301ebb352cc None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:36.528732 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a32a3a-4377-439a-8104-3301ebb352cc None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:36.562570 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7823de4-d774-4f32-a45d-581349324da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:36.563209 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7823de4-d774-4f32-a45d-581349324da1 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:36.563487 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7823de4-d774-4f32-a45d-581349324da1 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:36.563757 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7823de4-d774-4f32-a45d-581349324da1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:36.590868 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:36.630336 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7823de4-d774-4f32-a45d-581349324da1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:36.631707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7823de4-d774-4f32-a45d-581349324da1 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:36.730079 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 402/835] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:16:36 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 21:16:36.735930 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0f1ca-abea-4aff-9aa8-40b8af30ddb4 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:36.755175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:36.840147 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0f1ca-abea-4aff-9aa8-40b8af30ddb4 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:36.872883 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bf70d-84a1-4ada-b981-474cd957bd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:36.873504 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf70d-84a1-4ada-b981-474cd957bd87 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:36.873785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf70d-84a1-4ada-b981-474cd957bd87 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:36.874181 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bf70d-84a1-4ada-b981-474cd957bd87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:36.884325 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bf70d-84a1-4ada-b981-474cd957bd87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:36.885814 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bf70d-84a1-4ada-b981-474cd957bd87 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-7a2bf70d-84a1-4ada-b981-474cd957bd87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:16:36.901763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:36.903049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:16:36.904156 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:16:36.904156 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:36.904156 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:16:36.904156 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 434/836] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:36.908752 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7823de4-d774-4f32-a45d-581349324da1 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:36.966498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:37.006688 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7823de4-d774-4f32-a45d-581349324da1 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:37.041416 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de647ff-8404-4c96-afda-51c773dfa98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:37.042040 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de647ff-8404-4c96-afda-51c773dfa98e None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:37.042317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de647ff-8404-4c96-afda-51c773dfa98e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:37.042587 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de647ff-8404-4c96-afda-51c773dfa98e None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:37.043211 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de647ff-8404-4c96-afda-51c773dfa98e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:37.043509 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de647ff-8404-4c96-afda-51c773dfa98e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:37.044958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de647ff-8404-4c96-afda-51c773dfa98e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:37.056242 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 403/837] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:37.061964 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bf70d-84a1-4ada-b981-474cd957bd87 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:37.134700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:37.165148 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bf70d-84a1-4ada-b981-474cd957bd87 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:37.199109 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0306de-c91c-4365-bc7e-479a6043140e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:37.199764 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0306de-c91c-4365-bc7e-479a6043140e None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:37.200037 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0306de-c91c-4365-bc7e-479a6043140e None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:37.200303 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0306de-c91c-4365-bc7e-479a6043140e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:37.207136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0306de-c91c-4365-bc7e-479a6043140e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:37.208589 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0306de-c91c-4365-bc7e-479a6043140e None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-be0306de-c91c-4365-bc7e-479a6043140e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:16:37.219909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:37.221214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:37.222243 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:16:37.222243 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:16:37.222243 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:16:37.222243 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:16:37.222243 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:16:37.222243 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:16:37.222243 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:16:37.222243 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:16:37.222243 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 435/838] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:16:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:37.227279 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de647ff-8404-4c96-afda-51c773dfa98e None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:37.329517 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de647ff-8404-4c96-afda-51c773dfa98e None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:37.346632 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:37.364508 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a53a0c-ac8f-461e-a004-11b7fa48b172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:37.365157 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a53a0c-ac8f-461e-a004-11b7fa48b172 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:37.365489 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a53a0c-ac8f-461e-a004-11b7fa48b172 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:37.365753 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a53a0c-ac8f-461e-a004-11b7fa48b172 None admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:37.366430 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a53a0c-ac8f-461e-a004-11b7fa48b172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:37.366735 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a53a0c-ac8f-461e-a004-11b7fa48b172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:37.368866 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a53a0c-ac8f-461e-a004-11b7fa48b172 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:37.380788 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 404/839] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:16:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:37.386903 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0306de-c91c-4365-bc7e-479a6043140e None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:37.487841 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0306de-c91c-4365-bc7e-479a6043140e None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:37.518106 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:37.524142 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf517d-bf09-429f-b9fb-72955468cfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:37.524775 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf517d-bf09-429f-b9fb-72955468cfa9 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:37.525054 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf517d-bf09-429f-b9fb-72955468cfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:37.525321 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf517d-bf09-429f-b9fb-72955468cfa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:37.526092 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf517d-bf09-429f-b9fb-72955468cfa9 None admin] RBAC: Adding query filter params (role.id=a591fae52df7454f9d4067c495390a2e, scope.project.id=3bae29e3189d480c9200f03128f0c607, user.id=5fb45f9358b64974a39d996e93e5c105) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:37.526710 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf517d-bf09-429f-b9fb-72955468cfa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:37.528075 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf517d-bf09-429f-b9fb-72955468cfa9 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:37.533387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 436/840] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:16:37 2022] GET /identity/v3/role_assignments?user.id=5fb45f9358b64974a39d996e93e5c105&scope.project.id=3bae29e3189d480c9200f03128f0c607&role.id=a591fae52df7454f9d4067c495390a2e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:39.743221 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ac066-c8cc-4d9a-898c-7ee0ffaec816 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:39.743769 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ac066-c8cc-4d9a-898c-7ee0ffaec816 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:39.743769 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ac066-c8cc-4d9a-898c-7ee0ffaec816 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:39.745121 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 405/841] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:16:39.750707 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b440a-1f03-4573-98b9-ab69e5c522d9 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:39.751140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b440a-1f03-4573-98b9-ab69e5c522d9 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:39.751246 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b440a-1f03-4573-98b9-ab69e5c522d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:39.774166 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-4f8b440a-1f03-4573-98b9-ab69e5c522d9 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:16:39.775419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-4f8b440a-1f03-4573-98b9-ab69e5c522d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:16:39.844220 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 437/842] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:16:39 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:16:40.182302 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ac066-c8cc-4d9a-898c-7ee0ffaec816 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:40.286750 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ac066-c8cc-4d9a-898c-7ee0ffaec816 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:40.321140 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7eb59-acaa-4d93-ab54-e74d5987454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:40.321756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7eb59-acaa-4d93-ab54-e74d5987454f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:40.322029 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7eb59-acaa-4d93-ab54-e74d5987454f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:40.322296 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7eb59-acaa-4d93-ab54-e74d5987454f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:40.332395 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7eb59-acaa-4d93-ab54-e74d5987454f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-edd7eb59-acaa-4d93-ab54-e74d5987454f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:16:40.338300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:40.339282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:40.340266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:40.340266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:40.340266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:40.340266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:40.340266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:16:40.340266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:16:40.340266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:16:40.340266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:16:40.340266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:16:40.340266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:16:40.340266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:16:40.340266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:40.340266 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 406/843] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:16:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:40.345634 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b440a-1f03-4573-98b9-ab69e5c522d9 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:40.444879 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b440a-1f03-4573-98b9-ab69e5c522d9 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:40.469588 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:40.480223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c21d0b-c9f3-4abc-8e2f-bdfb50bb0295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:40.480857 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c21d0b-c9f3-4abc-8e2f-bdfb50bb0295 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:40.481139 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c21d0b-c9f3-4abc-8e2f-bdfb50bb0295 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:40.481411 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c21d0b-c9f3-4abc-8e2f-bdfb50bb0295 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:40.482061 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c21d0b-c9f3-4abc-8e2f-bdfb50bb0295 None admin] RBAC: Adding query filter params (name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:40.482362 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c21d0b-c9f3-4abc-8e2f-bdfb50bb0295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:40.483742 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c21d0b-c9f3-4abc-8e2f-bdfb50bb0295 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:40.491873 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 438/844] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:16:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:40.497832 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7eb59-acaa-4d93-ab54-e74d5987454f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:40.539319 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:40.597804 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7eb59-acaa-4d93-ab54-e74d5987454f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:40.631996 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed0ec9-d332-4bd5-a901-5965ad033917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:40.632644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed0ec9-d332-4bd5-a901-5965ad033917 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:40.633497 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed0ec9-d332-4bd5-a901-5965ad033917 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:40.633822 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed0ec9-d332-4bd5-a901-5965ad033917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:40.643842 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed0ec9-d332-4bd5-a901-5965ad033917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:40.645309 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed0ec9-d332-4bd5-a901-5965ad033917 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-18ed0ec9-d332-4bd5-a901-5965ad033917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:16:40.660576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:40.669463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:16:40.670362 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:16:40.670362 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:40.670362 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:40.670362 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 407/845] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:40.670594 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c21d0b-c9f3-4abc-8e2f-bdfb50bb0295 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:40.768842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c21d0b-c9f3-4abc-8e2f-bdfb50bb0295 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:40.802895 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f2b60-5e09-4304-9cdf-c99b1b29bd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:40.803396 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f2b60-5e09-4304-9cdf-c99b1b29bd6a None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:40.803727 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f2b60-5e09-4304-9cdf-c99b1b29bd6a None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:40.803947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f2b60-5e09-4304-9cdf-c99b1b29bd6a None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:40.804608 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f2b60-5e09-4304-9cdf-c99b1b29bd6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:40.804917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f2b60-5e09-4304-9cdf-c99b1b29bd6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:40.807159 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f2b60-5e09-4304-9cdf-c99b1b29bd6a None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:40.819374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 439/846] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:40.826210 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed0ec9-d332-4bd5-a901-5965ad033917 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:40.920983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:40.930756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed0ec9-d332-4bd5-a901-5965ad033917 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:40.963800 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ade4e-a118-4edc-9ec0-6b82c2946f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:40.964412 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ade4e-a118-4edc-9ec0-6b82c2946f0f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:40.964727 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ade4e-a118-4edc-9ec0-6b82c2946f0f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:40.965001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ade4e-a118-4edc-9ec0-6b82c2946f0f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:40.972397 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ade4e-a118-4edc-9ec0-6b82c2946f0f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:40.984261 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ade4e-a118-4edc-9ec0-6b82c2946f0f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-833ade4e-a118-4edc-9ec0-6b82c2946f0f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:16:40.985003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:40.986110 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:40.992179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:40.992179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:40.992179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:16:40.992179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:16:40.992179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:16:40.992179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:16:40.992179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:16:40.992179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:16:40.992179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 21:16:40.992179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:40.992179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 408/847] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:40.993585 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f2b60-5e09-4304-9cdf-c99b1b29bd6a None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:41.040818 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:41.096982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f2b60-5e09-4304-9cdf-c99b1b29bd6a None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:41.131759 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03461c-3858-4cdf-b386-ef69f2e88683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:41.132365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03461c-3858-4cdf-b386-ef69f2e88683 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:41.132694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03461c-3858-4cdf-b386-ef69f2e88683 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:41.132985 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03461c-3858-4cdf-b386-ef69f2e88683 None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:41.134032 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03461c-3858-4cdf-b386-ef69f2e88683 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:41.134345 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03461c-3858-4cdf-b386-ef69f2e88683 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:41.135780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03461c-3858-4cdf-b386-ef69f2e88683 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:41.154401 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 440/848] 10.222.0.43 () {56 vars in 1143 bytes} [Sat Sep 3 21:16:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:16:41.160394 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ade4e-a118-4edc-9ec0-6b82c2946f0f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:41.259466 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ade4e-a118-4edc-9ec0-6b82c2946f0f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:41.292360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4896dd0-6956-4b89-8778-0048df8b6201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:41.293002 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4896dd0-6956-4b89-8778-0048df8b6201 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:41.293279 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4896dd0-6956-4b89-8778-0048df8b6201 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:41.293548 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4896dd0-6956-4b89-8778-0048df8b6201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:41.303778 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4896dd0-6956-4b89-8778-0048df8b6201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:41.305834 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4896dd0-6956-4b89-8778-0048df8b6201 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-b4896dd0-6956-4b89-8778-0048df8b6201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:16:41.319445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:41.320580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:16:41.321773 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:16:41.321773 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:41.321773 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:41.321773 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 409/849] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:41.326419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03461c-3858-4cdf-b386-ef69f2e88683 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:41.428073 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03461c-3858-4cdf-b386-ef69f2e88683 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:41.430806 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:41.462181 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d28428-503e-4c1d-a4e1-bed9765a9022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:41.462770 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d28428-503e-4c1d-a4e1-bed9765a9022 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:41.463052 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d28428-503e-4c1d-a4e1-bed9765a9022 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:41.463322 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d28428-503e-4c1d-a4e1-bed9765a9022 None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:41.463954 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d28428-503e-4c1d-a4e1-bed9765a9022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:41.464253 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d28428-503e-4c1d-a4e1-bed9765a9022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:41.465664 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d28428-503e-4c1d-a4e1-bed9765a9022 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:41.477833 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 441/850] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:41.483731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4896dd0-6956-4b89-8778-0048df8b6201 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:41.486868 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:41.582352 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4896dd0-6956-4b89-8778-0048df8b6201 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:41.615495 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93bd54-e68d-4a15-860f-1d17f2e66b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:41.616114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93bd54-e68d-4a15-860f-1d17f2e66b1e None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:41.616397 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93bd54-e68d-4a15-860f-1d17f2e66b1e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:41.616701 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93bd54-e68d-4a15-860f-1d17f2e66b1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:41.623443 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93bd54-e68d-4a15-860f-1d17f2e66b1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:41.625017 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93bd54-e68d-4a15-860f-1d17f2e66b1e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-0a93bd54-e68d-4a15-860f-1d17f2e66b1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:16:41.637360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:41.638440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:41.639364 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:16:41.639364 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:16:41.639364 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:16:41.639364 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:16:41.639364 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:16:41.639364 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:16:41.639364 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:16:41.639364 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:41.639364 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 410/851] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:16:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:41.644696 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d28428-503e-4c1d-a4e1-bed9765a9022 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:41.750146 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d28428-503e-4c1d-a4e1-bed9765a9022 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:41.785620 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb75c2-e4e9-4ad2-bb9e-dc4c51084568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:41.786260 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb75c2-e4e9-4ad2-bb9e-dc4c51084568 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:41.786488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb75c2-e4e9-4ad2-bb9e-dc4c51084568 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:41.786761 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb75c2-e4e9-4ad2-bb9e-dc4c51084568 None admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:41.787450 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb75c2-e4e9-4ad2-bb9e-dc4c51084568 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:41.787753 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb75c2-e4e9-4ad2-bb9e-dc4c51084568 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:41.789214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb75c2-e4e9-4ad2-bb9e-dc4c51084568 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:41.801691 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 442/852] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:16:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:41.808050 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93bd54-e68d-4a15-860f-1d17f2e66b1e None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:41.872549 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:41.911960 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93bd54-e68d-4a15-860f-1d17f2e66b1e None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:41.944030 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143a732-bb25-45bd-ab8b-eafa99a8c701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:41.944744 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143a732-bb25-45bd-ab8b-eafa99a8c701 None admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:41.945026 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143a732-bb25-45bd-ab8b-eafa99a8c701 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:41.945300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143a732-bb25-45bd-ab8b-eafa99a8c701 None admin] PATH_INFO: `/v3/projects/3bae29e3189d480c9200f03128f0c607/users/5fb45f9358b64974a39d996e93e5c105/roles/a591fae52df7454f9d4067c495390a2e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:41.959743 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143a732-bb25-45bd-ab8b-eafa99a8c701 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bae29e3189d480c9200f03128f0c607, user_id=5fb45f9358b64974a39d996e93e5c105, role_id=a591fae52df7454f9d4067c495390a2e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:41.961224 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143a732-bb25-45bd-ab8b-eafa99a8c701 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:42.070224 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 411/853] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:16:41 2022] PUT /identity/v3/projects/3bae29e3189d480c9200f03128f0c607/users/5fb45f9358b64974a39d996e93e5c105/roles/a591fae52df7454f9d4067c495390a2e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:16:44.254474 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd27cb-87ff-42a1-a56f-c4378c3ef62f None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:44.255061 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd27cb-87ff-42a1-a56f-c4378c3ef62f None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:44.255061 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd27cb-87ff-42a1-a56f-c4378c3ef62f None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:44.256377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 443/854] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:16:44.262088 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30107912-67f7-46f8-a8e6-ea790b63e7d8 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:44.262531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30107912-67f7-46f8-a8e6-ea790b63e7d8 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:44.262646 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30107912-67f7-46f8-a8e6-ea790b63e7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:44.281730 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-30107912-67f7-46f8-a8e6-ea790b63e7d8 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:16:44.282850 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-30107912-67f7-46f8-a8e6-ea790b63e7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:16:44.350543 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 412/855] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:16:44 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:16:44.681801 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd27cb-87ff-42a1-a56f-c4378c3ef62f None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:44.708070 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:44.784109 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd27cb-87ff-42a1-a56f-c4378c3ef62f None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:44.818388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4f2ba-4408-4548-aa90-7fab96b07a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:44.819010 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4f2ba-4408-4548-aa90-7fab96b07a03 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:44.819280 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4f2ba-4408-4548-aa90-7fab96b07a03 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:44.819548 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4f2ba-4408-4548-aa90-7fab96b07a03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:44.829670 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4f2ba-4408-4548-aa90-7fab96b07a03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-ebb4f2ba-4408-4548-aa90-7fab96b07a03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:16:44.834551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:44.842225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:44.843333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:44.843333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:44.843333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:44.843333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:44.843333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:16:44.843333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:16:44.843333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:16:44.843333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:16:44.843333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:16:44.843333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:16:44.843333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 03 21:16:44.843333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:16:44.843333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 444/856] 10.222.0.43 () {56 vars in 1102 bytes} [Sat Sep 3 21:16:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:44.844255 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30107912-67f7-46f8-a8e6-ea790b63e7d8 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:44.886147 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:44.941094 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30107912-67f7-46f8-a8e6-ea790b63e7d8 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:44.974820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec75b9-65c2-471f-961e-700feb38e964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:44.978643 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec75b9-65c2-471f-961e-700feb38e964 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:44.978643 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec75b9-65c2-471f-961e-700feb38e964 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:44.978643 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec75b9-65c2-471f-961e-700feb38e964 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:44.978643 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec75b9-65c2-471f-961e-700feb38e964 None admin] RBAC: Adding query filter params (name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:44.978643 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec75b9-65c2-471f-961e-700feb38e964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:44.979076 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec75b9-65c2-471f-961e-700feb38e964 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:44.986601 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 413/857] 10.222.0.43 () {56 vars in 1103 bytes} [Sat Sep 3 21:16:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:44.993220 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4f2ba-4408-4548-aa90-7fab96b07a03 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:45.082468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:45.098210 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4f2ba-4408-4548-aa90-7fab96b07a03 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:45.132404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda85336-5779-4357-9601-37813bfba4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:45.133049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda85336-5779-4357-9601-37813bfba4f5 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:45.133714 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda85336-5779-4357-9601-37813bfba4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:45.133872 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda85336-5779-4357-9601-37813bfba4f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:45.144359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda85336-5779-4357-9601-37813bfba4f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:45.145834 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda85336-5779-4357-9601-37813bfba4f5 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-fda85336-5779-4357-9601-37813bfba4f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:16:45.160811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:45.161963 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:16:45.163058 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:16:45.163058 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:45.163058 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:16:45.163058 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 445/858] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:45.168712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec75b9-65c2-471f-961e-700feb38e964 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:45.269575 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec75b9-65c2-471f-961e-700feb38e964 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:45.271787 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:45.303816 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844a7d8-2433-403b-a613-f67bdb3f1a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:45.304413 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a7d8-2433-403b-a613-f67bdb3f1a41 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:45.304728 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a7d8-2433-403b-a613-f67bdb3f1a41 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:45.305187 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844a7d8-2433-403b-a613-f67bdb3f1a41 None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:45.305894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844a7d8-2433-403b-a613-f67bdb3f1a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:45.306204 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844a7d8-2433-403b-a613-f67bdb3f1a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:45.307583 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844a7d8-2433-403b-a613-f67bdb3f1a41 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:45.319281 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 414/859] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:45.325407 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda85336-5779-4357-9601-37813bfba4f5 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:45.428237 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda85336-5779-4357-9601-37813bfba4f5 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:45.461997 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccdfd4-877a-497e-a00f-b430c2808062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:45.462637 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccdfd4-877a-497e-a00f-b430c2808062 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:45.462917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccdfd4-877a-497e-a00f-b430c2808062 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:45.463192 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccdfd4-877a-497e-a00f-b430c2808062 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:45.465922 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:45.471030 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccdfd4-877a-497e-a00f-b430c2808062 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:45.472476 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccdfd4-877a-497e-a00f-b430c2808062 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-16ccdfd4-877a-497e-a00f-b430c2808062 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:16:45.484283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:45.501494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:45.502442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:45.502442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:45.502442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:16:45.502442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:16:45.502442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:16:45.502442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:16:45.502442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:16:45.502442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:16:45.502442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 21:16:45.502442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:16:45.502442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 446/860] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:45.503103 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844a7d8-2433-403b-a613-f67bdb3f1a41 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:45.594090 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844a7d8-2433-403b-a613-f67bdb3f1a41 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:45.628213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd0743-19e7-419b-90e3-b9ad76b3fabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:45.628871 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd0743-19e7-419b-90e3-b9ad76b3fabf None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:45.629151 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd0743-19e7-419b-90e3-b9ad76b3fabf None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:45.629428 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd0743-19e7-419b-90e3-b9ad76b3fabf None admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:45.630136 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd0743-19e7-419b-90e3-b9ad76b3fabf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:45.630473 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd0743-19e7-419b-90e3-b9ad76b3fabf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:45.631893 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd0743-19e7-419b-90e3-b9ad76b3fabf None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:45.650413 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 415/861] 10.222.0.43 () {56 vars in 1143 bytes} [Sat Sep 3 21:16:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:45.656548 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccdfd4-877a-497e-a00f-b430c2808062 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:45.758832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccdfd4-877a-497e-a00f-b430c2808062 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:45.792019 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe368c-4a94-4a64-ab60-31f4c71725f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:45.792650 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe368c-4a94-4a64-ab60-31f4c71725f8 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:45.792941 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe368c-4a94-4a64-ab60-31f4c71725f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:45.793220 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe368c-4a94-4a64-ab60-31f4c71725f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:45.856577 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:45.863044 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe368c-4a94-4a64-ab60-31f4c71725f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:45.864611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe368c-4a94-4a64-ab60-31f4c71725f8 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:45.962104 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 447/862] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:16:45 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 21:16:45.968027 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd0743-19e7-419b-90e3-b9ad76b3fabf None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:45.992210 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:46.079211 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd0743-19e7-419b-90e3-b9ad76b3fabf None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:46.113599 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8d011-08e4-41ff-a4af-ec87e12ce676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:46.114345 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8d011-08e4-41ff-a4af-ec87e12ce676 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:46.114626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8d011-08e4-41ff-a4af-ec87e12ce676 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:46.114901 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8d011-08e4-41ff-a4af-ec87e12ce676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:46.125601 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8d011-08e4-41ff-a4af-ec87e12ce676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:46.127141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8d011-08e4-41ff-a4af-ec87e12ce676 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-4ac8d011-08e4-41ff-a4af-ec87e12ce676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:16:46.142177 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:46.143399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:16:46.144503 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:16:46.144503 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:46.144503 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:46.144503 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 416/863] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:46.149296 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe368c-4a94-4a64-ab60-31f4c71725f8 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:46.242128 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:46.248638 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe368c-4a94-4a64-ab60-31f4c71725f8 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:46.287525 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f5ced-c7dd-4c96-8842-82ce05e9a96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:46.293298 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f5ced-c7dd-4c96-8842-82ce05e9a96d None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:46.293298 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f5ced-c7dd-4c96-8842-82ce05e9a96d None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:46.293298 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f5ced-c7dd-4c96-8842-82ce05e9a96d None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:46.293298 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f5ced-c7dd-4c96-8842-82ce05e9a96d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:46.293298 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f5ced-c7dd-4c96-8842-82ce05e9a96d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:46.293298 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f5ced-c7dd-4c96-8842-82ce05e9a96d None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:46.303334 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 448/864] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:46.310557 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8d011-08e4-41ff-a4af-ec87e12ce676 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:46.386108 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:46.410159 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8d011-08e4-41ff-a4af-ec87e12ce676 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:46.443928 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b67c9-eaf8-49d7-a4cb-ef442b0a28d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:46.444587 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b67c9-eaf8-49d7-a4cb-ef442b0a28d7 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:46.444875 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b67c9-eaf8-49d7-a4cb-ef442b0a28d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:46.445151 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b67c9-eaf8-49d7-a4cb-ef442b0a28d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:46.451986 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b67c9-eaf8-49d7-a4cb-ef442b0a28d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:46.453946 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b67c9-eaf8-49d7-a4cb-ef442b0a28d7 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-ee2b67c9-eaf8-49d7-a4cb-ef442b0a28d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:16:46.465918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:46.467005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:46.468143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:16:46.468143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:16:46.468143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:16:46.468143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:16:46.468143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:16:46.468143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:16:46.468143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:16:46.468143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:46.468143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 417/865] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:46.472978 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f5ced-c7dd-4c96-8842-82ce05e9a96d None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:46.577450 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f5ced-c7dd-4c96-8842-82ce05e9a96d None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:46.611374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a738b64-8800-4af7-9a48-a5681b7afb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:46.611997 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a738b64-8800-4af7-9a48-a5681b7afb55 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:46.612268 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a738b64-8800-4af7-9a48-a5681b7afb55 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:46.612584 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a738b64-8800-4af7-9a48-a5681b7afb55 None admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:46.613259 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a738b64-8800-4af7-9a48-a5681b7afb55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:46.613565 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a738b64-8800-4af7-9a48-a5681b7afb55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:46.615034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a738b64-8800-4af7-9a48-a5681b7afb55 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:46.628755 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 449/866] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:16:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:46.635086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b67c9-eaf8-49d7-a4cb-ef442b0a28d7 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:46.736747 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b67c9-eaf8-49d7-a4cb-ef442b0a28d7 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:46.770322 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac4c7a-a0ab-4066-ac3f-2bc09d01a7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:46.770913 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac4c7a-a0ab-4066-ac3f-2bc09d01a7ea None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:46.771204 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac4c7a-a0ab-4066-ac3f-2bc09d01a7ea None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:46.771476 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac4c7a-a0ab-4066-ac3f-2bc09d01a7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:46.772180 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac4c7a-a0ab-4066-ac3f-2bc09d01a7ea None admin] RBAC: Adding query filter params (role.id=a591fae52df7454f9d4067c495390a2e, scope.project.id=3bae29e3189d480c9200f03128f0c607, user.id=5fb45f9358b64974a39d996e93e5c105) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:46.772484 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac4c7a-a0ab-4066-ac3f-2bc09d01a7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:46.774012 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac4c7a-a0ab-4066-ac3f-2bc09d01a7ea None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:46.775772 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:46.780473 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 418/867] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:16:46 2022] GET /identity/v3/role_assignments?user.id=5fb45f9358b64974a39d996e93e5c105&scope.project.id=3bae29e3189d480c9200f03128f0c607&role.id=a591fae52df7454f9d4067c495390a2e => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:49.050579 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839ee1a-f423-4445-8912-fe9ffe7b5c19 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:49.051099 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839ee1a-f423-4445-8912-fe9ffe7b5c19 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:49.051191 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839ee1a-f423-4445-8912-fe9ffe7b5c19 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:49.052482 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 450/868] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:16:49.058412 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a89e2-006b-4f71-91c3-8d542b681c2b None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:49.058861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a89e2-006b-4f71-91c3-8d542b681c2b None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:49.058960 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a89e2-006b-4f71-91c3-8d542b681c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:49.079026 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-8a9a89e2-006b-4f71-91c3-8d542b681c2b None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:16:49.080303 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-8a9a89e2-006b-4f71-91c3-8d542b681c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:16:49.151883 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 419/869] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:16:49 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:16:49.488403 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839ee1a-f423-4445-8912-fe9ffe7b5c19 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:49.507309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:49.591693 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839ee1a-f423-4445-8912-fe9ffe7b5c19 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:49.627660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e5ae0-c664-4b34-a094-3a8488f73211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:49.628308 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e5ae0-c664-4b34-a094-3a8488f73211 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:49.628695 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e5ae0-c664-4b34-a094-3a8488f73211 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:49.628973 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e5ae0-c664-4b34-a094-3a8488f73211 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:49.639248 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e5ae0-c664-4b34-a094-3a8488f73211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-df0e5ae0-c664-4b34-a094-3a8488f73211 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:16:49.644326 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:49.645429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:49.646813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:49.646813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:49.646813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:49.646813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:49.646813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:16:49.646813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:16:49.646813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:16:49.646813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:16:49.646813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:16:49.646813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:16:49.646813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:16:49.646813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:16:49.646813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 451/870] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:16:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:49.652283 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a89e2-006b-4f71-91c3-8d542b681c2b None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:49.751580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a89e2-006b-4f71-91c3-8d542b681c2b None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:49.777986 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:49.786070 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa0303-a41b-40b3-ac58-d0cf4a8845e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:49.786668 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0303-a41b-40b3-ac58-d0cf4a8845e2 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:49.786939 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0303-a41b-40b3-ac58-d0cf4a8845e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:49.787207 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0303-a41b-40b3-ac58-d0cf4a8845e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:49.787854 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa0303-a41b-40b3-ac58-d0cf4a8845e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:49.788150 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa0303-a41b-40b3-ac58-d0cf4a8845e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:49.790573 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa0303-a41b-40b3-ac58-d0cf4a8845e2 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:49.799012 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 420/871] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:16:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:49.804945 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e5ae0-c664-4b34-a094-3a8488f73211 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:49.882296 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:49.905320 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e5ae0-c664-4b34-a094-3a8488f73211 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:49.938769 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59290459-b837-4b1d-8e8c-78bbbf3db0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:49.939384 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59290459-b837-4b1d-8e8c-78bbbf3db0db None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:49.939668 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59290459-b837-4b1d-8e8c-78bbbf3db0db None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:49.939934 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59290459-b837-4b1d-8e8c-78bbbf3db0db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:49.949536 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59290459-b837-4b1d-8e8c-78bbbf3db0db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:49.950980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59290459-b837-4b1d-8e8c-78bbbf3db0db None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-59290459-b837-4b1d-8e8c-78bbbf3db0db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:16:49.965793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:49.966917 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:16:49.968196 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:16:49.968196 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:49.968196 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:16:49.968196 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 452/872] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:49.972816 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa0303-a41b-40b3-ac58-d0cf4a8845e2 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:50.076301 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa0303-a41b-40b3-ac58-d0cf4a8845e2 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:50.111291 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880af80-38ff-40a2-b92a-52ec1118dbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:50.111890 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880af80-38ff-40a2-b92a-52ec1118dbfc None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:50.112169 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880af80-38ff-40a2-b92a-52ec1118dbfc None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:50.112445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880af80-38ff-40a2-b92a-52ec1118dbfc None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:50.113105 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880af80-38ff-40a2-b92a-52ec1118dbfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:50.113416 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880af80-38ff-40a2-b92a-52ec1118dbfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:50.114779 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880af80-38ff-40a2-b92a-52ec1118dbfc None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:50.126859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 421/873] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:50.132669 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59290459-b837-4b1d-8e8c-78bbbf3db0db None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:50.234602 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59290459-b837-4b1d-8e8c-78bbbf3db0db None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:50.260353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:50.269484 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6271e30-5a15-45e5-a93b-6aba22c5eef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:50.269484 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6271e30-5a15-45e5-a93b-6aba22c5eef5 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:50.269484 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6271e30-5a15-45e5-a93b-6aba22c5eef5 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:50.269484 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6271e30-5a15-45e5-a93b-6aba22c5eef5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:50.277925 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6271e30-5a15-45e5-a93b-6aba22c5eef5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:50.279364 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6271e30-5a15-45e5-a93b-6aba22c5eef5 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-f6271e30-5a15-45e5-a93b-6aba22c5eef5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:16:50.290549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:50.291684 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:50.292765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:50.292765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:50.292765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:16:50.292765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:16:50.292765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:16:50.292765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:16:50.292765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:16:50.292765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:16:50.292765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 21:16:50.292765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:16:50.292765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 453/874] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:50.297794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880af80-38ff-40a2-b92a-52ec1118dbfc None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:50.348972 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:50.397971 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880af80-38ff-40a2-b92a-52ec1118dbfc None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:50.433065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd146a-e2bc-4fe7-80a0-47497a309a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:50.433660 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd146a-e2bc-4fe7-80a0-47497a309a3b None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:50.433938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd146a-e2bc-4fe7-80a0-47497a309a3b None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:50.434208 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd146a-e2bc-4fe7-80a0-47497a309a3b None admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:50.434921 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd146a-e2bc-4fe7-80a0-47497a309a3b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:50.435228 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd146a-e2bc-4fe7-80a0-47497a309a3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:50.436685 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd146a-e2bc-4fe7-80a0-47497a309a3b None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:50.454825 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 422/875] 10.222.0.43 () {56 vars in 1143 bytes} [Sat Sep 3 21:16:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:50.460565 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6271e30-5a15-45e5-a93b-6aba22c5eef5 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:50.563522 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6271e30-5a15-45e5-a93b-6aba22c5eef5 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:50.597279 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157ae65-faee-4aa4-884d-5331ef8adbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:50.597868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157ae65-faee-4aa4-884d-5331ef8adbbc None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:50.598144 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157ae65-faee-4aa4-884d-5331ef8adbbc None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:50.598410 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157ae65-faee-4aa4-884d-5331ef8adbbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:50.652751 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:50.664767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157ae65-faee-4aa4-884d-5331ef8adbbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:50.666232 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157ae65-faee-4aa4-884d-5331ef8adbbc None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:50.763168 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 454/876] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:16:50 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 21:16:50.769125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd146a-e2bc-4fe7-80a0-47497a309a3b None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:50.871389 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd146a-e2bc-4fe7-80a0-47497a309a3b None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:50.881078 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:50.907556 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4e32c-d2be-46c0-867f-80248f148684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:50.908205 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e32c-d2be-46c0-867f-80248f148684 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:50.908481 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e32c-d2be-46c0-867f-80248f148684 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:50.908792 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4e32c-d2be-46c0-867f-80248f148684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:50.918535 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4e32c-d2be-46c0-867f-80248f148684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:50.920000 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4e32c-d2be-46c0-867f-80248f148684 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-a6d4e32c-d2be-46c0-867f-80248f148684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:16:50.934644 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:50.935861 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:16:50.936817 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:16:50.936817 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:50.936817 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:50.936817 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 423/877] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:50.941763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157ae65-faee-4aa4-884d-5331ef8adbbc None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:51.029299 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:51.041171 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157ae65-faee-4aa4-884d-5331ef8adbbc None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:51.074054 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caeb94-8e43-4059-aacc-261c7a57f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:51.074664 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caeb94-8e43-4059-aacc-261c7a57f1cf None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:51.075157 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caeb94-8e43-4059-aacc-261c7a57f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:51.075622 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caeb94-8e43-4059-aacc-261c7a57f1cf None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:51.076674 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8caeb94-8e43-4059-aacc-261c7a57f1cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:51.076984 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8caeb94-8e43-4059-aacc-261c7a57f1cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:51.078366 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8caeb94-8e43-4059-aacc-261c7a57f1cf None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:51.090567 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 455/878] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:51.096354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4e32c-d2be-46c0-867f-80248f148684 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:51.199970 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4e32c-d2be-46c0-867f-80248f148684 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:51.233082 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77d4a0-bf53-4857-84d7-f760b228c88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:51.233704 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77d4a0-bf53-4857-84d7-f760b228c88a None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:51.233984 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77d4a0-bf53-4857-84d7-f760b228c88a None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:51.234257 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77d4a0-bf53-4857-84d7-f760b228c88a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:51.240747 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77d4a0-bf53-4857-84d7-f760b228c88a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:51.242192 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a77d4a0-bf53-4857-84d7-f760b228c88a None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-3a77d4a0-bf53-4857-84d7-f760b228c88a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:16:51.254113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:51.255250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:51.256178 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:16:51.256178 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:16:51.256178 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:16:51.256178 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:16:51.256178 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:16:51.256178 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:16:51.256178 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:16:51.256178 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:51.256178 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 424/879] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:51.262208 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caeb94-8e43-4059-aacc-261c7a57f1cf None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:51.363636 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caeb94-8e43-4059-aacc-261c7a57f1cf None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:51.400011 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0900886-c195-40ff-b5af-dcb06aecd681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:51.400643 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0900886-c195-40ff-b5af-dcb06aecd681 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:51.400929 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0900886-c195-40ff-b5af-dcb06aecd681 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:51.401204 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0900886-c195-40ff-b5af-dcb06aecd681 None admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:51.402141 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0900886-c195-40ff-b5af-dcb06aecd681 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:51.402448 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0900886-c195-40ff-b5af-dcb06aecd681 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:51.403868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0900886-c195-40ff-b5af-dcb06aecd681 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:51.416192 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 456/880] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:51.422559 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77d4a0-bf53-4857-84d7-f760b228c88a None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:51.447493 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:51.526303 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77d4a0-bf53-4857-84d7-f760b228c88a None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:51.562470 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ef639-ab38-4c31-8292-a2731a35bb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:51.563070 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ef639-ab38-4c31-8292-a2731a35bb3e None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:51.563351 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ef639-ab38-4c31-8292-a2731a35bb3e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:51.563623 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ef639-ab38-4c31-8292-a2731a35bb3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:51.564337 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ef639-ab38-4c31-8292-a2731a35bb3e None admin] RBAC: Adding query filter params (role.id=a1c22a1558c34c1d9d262bf1da31887e, scope.project.id=3bae29e3189d480c9200f03128f0c607, user.id=5fb45f9358b64974a39d996e93e5c105) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:51.564690 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ef639-ab38-4c31-8292-a2731a35bb3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:51.566248 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ef639-ab38-4c31-8292-a2731a35bb3e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:51.572166 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 425/881] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:16:51 2022] GET /identity/v3/role_assignments?user.id=5fb45f9358b64974a39d996e93e5c105&scope.project.id=3bae29e3189d480c9200f03128f0c607&role.id=a1c22a1558c34c1d9d262bf1da31887e => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:53.785855 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74688b-a0f7-4a5d-82d5-c804217f15f6 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:53.786403 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74688b-a0f7-4a5d-82d5-c804217f15f6 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:53.786403 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74688b-a0f7-4a5d-82d5-c804217f15f6 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:53.787767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 457/882] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:16:53.793780 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64e573-6d7f-4504-9805-ce46dae1d07f None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:53.794189 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64e573-6d7f-4504-9805-ce46dae1d07f None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:53.794325 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64e573-6d7f-4504-9805-ce46dae1d07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:53.812561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-af64e573-6d7f-4504-9805-ce46dae1d07f None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:16:53.813728 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-af64e573-6d7f-4504-9805-ce46dae1d07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:16:53.885920 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 426/883] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:16:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 03 21:16:54.215976 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74688b-a0f7-4a5d-82d5-c804217f15f6 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:54.227431 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:54.315508 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74688b-a0f7-4a5d-82d5-c804217f15f6 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:54.348995 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43e6ef-c000-4101-af10-8e69aa6e2ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:54.349825 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43e6ef-c000-4101-af10-8e69aa6e2ced None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:54.350356 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43e6ef-c000-4101-af10-8e69aa6e2ced None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:54.350655 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae43e6ef-c000-4101-af10-8e69aa6e2ced None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:54.361887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae43e6ef-c000-4101-af10-8e69aa6e2ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-ae43e6ef-c000-4101-af10-8e69aa6e2ced None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:16:54.366768 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:54.369151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:54.370180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:54.370180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:54.370180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:54.370180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:54.370180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:16:54.370180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:16:54.370180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:16:54.370180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:16:54.370180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:16:54.370180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:16:54.370180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:16:54.370180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:16:54.370180 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 458/884] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:16:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:54.374736 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64e573-6d7f-4504-9805-ce46dae1d07f None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:54.392127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:54.476490 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64e573-6d7f-4504-9805-ce46dae1d07f None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:54.510686 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f89024-95cd-43f6-82be-b90709615ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:54.511283 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f89024-95cd-43f6-82be-b90709615ac2 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:54.511565 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f89024-95cd-43f6-82be-b90709615ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:54.511836 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f89024-95cd-43f6-82be-b90709615ac2 None admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:54.512492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f89024-95cd-43f6-82be-b90709615ac2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:54.512826 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f89024-95cd-43f6-82be-b90709615ac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:54.514313 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f89024-95cd-43f6-82be-b90709615ac2 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:54.522292 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 427/885] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:16:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:54.529423 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43e6ef-c000-4101-af10-8e69aa6e2ced None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:54.599981 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:54.634121 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae43e6ef-c000-4101-af10-8e69aa6e2ced None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:54.668010 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c7fd-33c0-4408-97e2-140ffe1b840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:54.668736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c7fd-33c0-4408-97e2-140ffe1b840c None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:54.669016 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c7fd-33c0-4408-97e2-140ffe1b840c None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:54.669290 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c7fd-33c0-4408-97e2-140ffe1b840c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:54.679527 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697c7fd-33c0-4408-97e2-140ffe1b840c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:54.681127 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697c7fd-33c0-4408-97e2-140ffe1b840c None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-8697c7fd-33c0-4408-97e2-140ffe1b840c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:16:54.694937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:54.697065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:16:54.698138 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:16:54.698138 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:54.698138 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:16:54.698138 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 459/886] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:54.702731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f89024-95cd-43f6-82be-b90709615ac2 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:54.786611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:54.809374 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f89024-95cd-43f6-82be-b90709615ac2 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:54.842648 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c64b1-2ca7-48c9-8ab1-e740e8a5017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:54.843240 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c64b1-2ca7-48c9-8ab1-e740e8a5017f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:54.843514 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c64b1-2ca7-48c9-8ab1-e740e8a5017f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:54.843785 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c64b1-2ca7-48c9-8ab1-e740e8a5017f None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:54.844407 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c64b1-2ca7-48c9-8ab1-e740e8a5017f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:54.844739 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c64b1-2ca7-48c9-8ab1-e740e8a5017f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:54.846128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c64b1-2ca7-48c9-8ab1-e740e8a5017f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:54.857976 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 428/887] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:54.864097 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c7fd-33c0-4408-97e2-140ffe1b840c None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:54.964794 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c7fd-33c0-4408-97e2-140ffe1b840c None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:54.984248 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:54.998535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfedea-8904-426e-b4d2-79c498f1946b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:54.999162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfedea-8904-426e-b4d2-79c498f1946b None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:54.999436 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfedea-8904-426e-b4d2-79c498f1946b None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:54.999708 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfedea-8904-426e-b4d2-79c498f1946b None admin] PATH_INFO: `/v3/users/placement` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:55.007113 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdfedea-8904-426e-b4d2-79c498f1946b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:55.009338 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdfedea-8904-426e-b4d2-79c498f1946b None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-efdfedea-8904-426e-b4d2-79c498f1946b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:16:55.020388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:55.023355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:55.025105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:55.025105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:55.025105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:16:55.025105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:16:55.025105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:16:55.025105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:16:55.025105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:16:55.025105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:16:55.025105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 21:16:55.025105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:16:55.025105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 460/888] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:55.027656 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c64b1-2ca7-48c9-8ab1-e740e8a5017f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:55.128241 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c64b1-2ca7-48c9-8ab1-e740e8a5017f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:55.162999 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f2d3-a599-462c-a38e-173f2901b58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:55.165031 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f2d3-a599-462c-a38e-173f2901b58b None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:55.165031 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f2d3-a599-462c-a38e-173f2901b58b None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:55.165031 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f2d3-a599-462c-a38e-173f2901b58b None admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:55.165031 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0f2d3-a599-462c-a38e-173f2901b58b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:55.165373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0f2d3-a599-462c-a38e-173f2901b58b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:55.166798 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0f2d3-a599-462c-a38e-173f2901b58b None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:55.169399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:55.184330 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 429/889] 10.222.0.43 () {56 vars in 1143 bytes} [Sat Sep 3 21:16:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:55.190259 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfedea-8904-426e-b4d2-79c498f1946b None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:55.295426 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfedea-8904-426e-b4d2-79c498f1946b None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:55.328297 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c6921-b29f-4ff8-83c8-509086ea2d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:55.328942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c6921-b29f-4ff8-83c8-509086ea2d8a None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:55.329221 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c6921-b29f-4ff8-83c8-509086ea2d8a None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:55.329494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c6921-b29f-4ff8-83c8-509086ea2d8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:55.339607 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c6921-b29f-4ff8-83c8-509086ea2d8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:55.341073 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c6921-b29f-4ff8-83c8-509086ea2d8a None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-623c6921-b29f-4ff8-83c8-509086ea2d8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:16:55.355255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:55.356333 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:16:55.357587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:16:55.357587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:55.357587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:16:55.357587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 461/890] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:55.362309 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f2d3-a599-462c-a38e-173f2901b58b None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:55.463489 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f2d3-a599-462c-a38e-173f2901b58b None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:55.498546 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11467e6-b51b-4c48-b8ed-a2282c87357c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:55.499141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11467e6-b51b-4c48-b8ed-a2282c87357c None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:55.499425 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11467e6-b51b-4c48-b8ed-a2282c87357c None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:55.499695 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11467e6-b51b-4c48-b8ed-a2282c87357c None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:55.500321 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11467e6-b51b-4c48-b8ed-a2282c87357c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:55.500651 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11467e6-b51b-4c48-b8ed-a2282c87357c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:55.502021 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11467e6-b51b-4c48-b8ed-a2282c87357c None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:55.513592 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 430/891] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:55.519797 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c6921-b29f-4ff8-83c8-509086ea2d8a None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:55.553284 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:55.623624 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c6921-b29f-4ff8-83c8-509086ea2d8a None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:55.659349 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107c66e-5437-4515-aca2-3c7b87653817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:55.659977 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c66e-5437-4515-aca2-3c7b87653817 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:55.660263 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c66e-5437-4515-aca2-3c7b87653817 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:55.660555 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c66e-5437-4515-aca2-3c7b87653817 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:55.668218 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107c66e-5437-4515-aca2-3c7b87653817 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:55.669695 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107c66e-5437-4515-aca2-3c7b87653817 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-9107c66e-5437-4515-aca2-3c7b87653817 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:16:55.681359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:55.682355 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:55.683515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:16:55.683515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:16:55.683515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:16:55.683515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:16:55.683515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:16:55.683515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:16:55.683515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:16:55.683515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:16:55.683515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 462/892] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:55.688794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11467e6-b51b-4c48-b8ed-a2282c87357c None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:55.747165 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:55.792445 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11467e6-b51b-4c48-b8ed-a2282c87357c None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:55.826077 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7886e-80b0-4eba-85ca-b9f398c668ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:55.826700 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7886e-80b0-4eba-85ca-b9f398c668ba None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:55.826941 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7886e-80b0-4eba-85ca-b9f398c668ba None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:55.827211 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7886e-80b0-4eba-85ca-b9f398c668ba None admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:55.828030 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7886e-80b0-4eba-85ca-b9f398c668ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:55.828332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7886e-80b0-4eba-85ca-b9f398c668ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:55.829795 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7886e-80b0-4eba-85ca-b9f398c668ba None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:55.841469 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 431/893] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:16:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:55.847822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107c66e-5437-4515-aca2-3c7b87653817 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:55.941054 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:55.950214 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107c66e-5437-4515-aca2-3c7b87653817 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:55.982086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31bc26-7978-461c-a82b-ea2512fa4c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:55.982729 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31bc26-7978-461c-a82b-ea2512fa4c39 None admin] REQUEST_METHOD: `PUT` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:55.983028 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31bc26-7978-461c-a82b-ea2512fa4c39 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:55.983298 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31bc26-7978-461c-a82b-ea2512fa4c39 None admin] PATH_INFO: `/v3/projects/3bae29e3189d480c9200f03128f0c607/users/5fb45f9358b64974a39d996e93e5c105/roles/a1c22a1558c34c1d9d262bf1da31887e` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:55.985241 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31bc26-7978-461c-a82b-ea2512fa4c39 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bae29e3189d480c9200f03128f0c607, user_id=5fb45f9358b64974a39d996e93e5c105, role_id=a1c22a1558c34c1d9d262bf1da31887e)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:55.986662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31bc26-7978-461c-a82b-ea2512fa4c39 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:56.121669 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 463/894] 10.222.0.43 () {58 vars in 1439 bytes} [Sat Sep 3 21:16:55 2022] PUT /identity/v3/projects/3bae29e3189d480c9200f03128f0c607/users/5fb45f9358b64974a39d996e93e5c105/roles/a1c22a1558c34c1d9d262bf1da31887e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:16:58.375401 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff6dbf-c96e-409c-8a0d-679a8931b952 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:58.375922 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff6dbf-c96e-409c-8a0d-679a8931b952 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:58.375922 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff6dbf-c96e-409c-8a0d-679a8931b952 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:58.377253 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 432/895] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:16:58.382313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa0a8c-9ad8-430c-ab4a-da0706431d62 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:58.382702 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa0a8c-9ad8-430c-ab4a-da0706431d62 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:58.382870 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa0a8c-9ad8-430c-ab4a-da0706431d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:58.402156 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-8bfa0a8c-9ad8-430c-ab4a-da0706431d62 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:16:58.403343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-8bfa0a8c-9ad8-430c-ab4a-da0706431d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:16:58.471938 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 464/896] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:16:58 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:16:58.810367 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff6dbf-c96e-409c-8a0d-679a8931b952 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:58.913001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff6dbf-c96e-409c-8a0d-679a8931b952 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:58.927793 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:58.947673 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002724b-6de6-4b39-bd18-7c2247802428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:58.948288 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002724b-6de6-4b39-bd18-7c2247802428 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:58.948670 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002724b-6de6-4b39-bd18-7c2247802428 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:58.948966 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002724b-6de6-4b39-bd18-7c2247802428 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:58.959159 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002724b-6de6-4b39-bd18-7c2247802428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-f002724b-6de6-4b39-bd18-7c2247802428 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 03 21:16:58.964983 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:58.966072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:58.966907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:58.966907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:58.966907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:58.966907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:58.966907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 03 21:16:58.966907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 03 21:16:58.966907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 03 21:16:58.966907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 03 21:16:58.966907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 03 21:16:58.966907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 03 21:16:58.966907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 03 21:16:58.966907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:58.966907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 433/897] 10.222.0.43 () {56 vars in 1096 bytes} [Sat Sep 3 21:16:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:58.972424 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa0a8c-9ad8-430c-ab4a-da0706431d62 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:59.055851 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:59.074151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa0a8c-9ad8-430c-ab4a-da0706431d62 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:59.107740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fd92b-a6ce-464a-9e47-1b1966162d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:59.108341 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fd92b-a6ce-464a-9e47-1b1966162d89 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:59.108784 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fd92b-a6ce-464a-9e47-1b1966162d89 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:59.109060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fd92b-a6ce-464a-9e47-1b1966162d89 None admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:59.109716 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fd92b-a6ce-464a-9e47-1b1966162d89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:59.110018 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fd92b-a6ce-464a-9e47-1b1966162d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:59.111372 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fd92b-a6ce-464a-9e47-1b1966162d89 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:59.119624 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 465/898] 10.222.0.43 () {56 vars in 1099 bytes} [Sat Sep 3 21:16:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:59.125870 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002724b-6de6-4b39-bd18-7c2247802428 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:59.230865 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002724b-6de6-4b39-bd18-7c2247802428 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:59.265535 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800eda3d-9870-489b-8762-743da183555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:59.266159 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800eda3d-9870-489b-8762-743da183555f None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:59.266437 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800eda3d-9870-489b-8762-743da183555f None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:59.266709 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800eda3d-9870-489b-8762-743da183555f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:59.277581 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800eda3d-9870-489b-8762-743da183555f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:59.279024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800eda3d-9870-489b-8762-743da183555f None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-800eda3d-9870-489b-8762-743da183555f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:16:59.295794 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:59.296954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:16:59.298052 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:16:59.298052 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:16:59.298052 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:59.298052 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 434/899] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:59.302905 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fd92b-a6ce-464a-9e47-1b1966162d89 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:59.405119 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fd92b-a6ce-464a-9e47-1b1966162d89 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:59.438522 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1e71c-c0d6-4f61-ba7a-54aac60871f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:59.439114 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1e71c-c0d6-4f61-ba7a-54aac60871f2 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:59.439393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1e71c-c0d6-4f61-ba7a-54aac60871f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:59.439662 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1e71c-c0d6-4f61-ba7a-54aac60871f2 None admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:59.440335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1e71c-c0d6-4f61-ba7a-54aac60871f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:59.440668 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1e71c-c0d6-4f61-ba7a-54aac60871f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:59.442024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1e71c-c0d6-4f61-ba7a-54aac60871f2 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:59.454421 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 466/900] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:59.460241 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800eda3d-9870-489b-8762-743da183555f None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:59.489560 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:59.563859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800eda3d-9870-489b-8762-743da183555f None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:59.597228 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7881b2-32f5-42fd-ac57-2b879ff3c011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:59.597849 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7881b2-32f5-42fd-ac57-2b879ff3c011 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:59.598127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7881b2-32f5-42fd-ac57-2b879ff3c011 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:59.598396 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7881b2-32f5-42fd-ac57-2b879ff3c011 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:59.606114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7881b2-32f5-42fd-ac57-2b879ff3c011 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:59.607543 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7881b2-32f5-42fd-ac57-2b879ff3c011 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-ea7881b2-32f5-42fd-ac57-2b879ff3c011 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 03 21:16:59.619127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:16:59.620217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:16:59.621404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:16:59.621404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:16:59.621404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 03 21:16:59.621404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 03 21:16:59.621404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 03 21:16:59.621404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 03 21:16:59.621404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 03 21:16:59.621404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 03 21:16:59.621404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 03 21:16:59.621404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:16:59.621404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 435/901] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:16:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:16:59.626296 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1e71c-c0d6-4f61-ba7a-54aac60871f2 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:59.630269 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:59.725226 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1e71c-c0d6-4f61-ba7a-54aac60871f2 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:59.762228 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513423d-2adc-4250-8c26-5fea12e91e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:59.762829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513423d-2adc-4250-8c26-5fea12e91e80 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:59.763109 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513423d-2adc-4250-8c26-5fea12e91e80 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:59.763380 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513423d-2adc-4250-8c26-5fea12e91e80 None admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:59.764097 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513423d-2adc-4250-8c26-5fea12e91e80 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:16:59.764400 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513423d-2adc-4250-8c26-5fea12e91e80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:16:59.765862 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513423d-2adc-4250-8c26-5fea12e91e80 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:16:59.783518 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 467/902] 10.222.0.43 () {56 vars in 1143 bytes} [Sat Sep 3 21:16:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:16:59.790031 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7881b2-32f5-42fd-ac57-2b879ff3c011 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:16:59.878704 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:16:59.894460 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7881b2-32f5-42fd-ac57-2b879ff3c011 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:16:59.929478 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e298fb-b9fc-4c79-a325-443609e4a349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:16:59.930718 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e298fb-b9fc-4c79-a325-443609e4a349 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:16:59.931188 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e298fb-b9fc-4c79-a325-443609e4a349 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:16:59.931540 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e298fb-b9fc-4c79-a325-443609e4a349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:16:59.998911 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e298fb-b9fc-4c79-a325-443609e4a349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:00.000294 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e298fb-b9fc-4c79-a325-443609e4a349 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:00.085779 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:00.101479 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 436/903] 10.222.0.43 () {58 vars in 1282 bytes} [Sat Sep 3 21:16:59 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 03 21:17:00.107932 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513423d-2adc-4250-8c26-5fea12e91e80 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:00.173621 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:00.211835 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513423d-2adc-4250-8c26-5fea12e91e80 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:00.245103 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26f53d-554d-4da3-8d5e-7216b9609d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:00.245765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26f53d-554d-4da3-8d5e-7216b9609d3d None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:00.246100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26f53d-554d-4da3-8d5e-7216b9609d3d None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:00.246379 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26f53d-554d-4da3-8d5e-7216b9609d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:00.256224 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26f53d-554d-4da3-8d5e-7216b9609d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:00.257813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26f53d-554d-4da3-8d5e-7216b9609d3d None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-5f26f53d-554d-4da3-8d5e-7216b9609d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 03 21:17:00.272082 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:17:00.273468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 03 21:17:00.275814 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 03 21:17:00.275814 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 03 21:17:00.275814 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:17:00.275814 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 468/904] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:17:00.280128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e298fb-b9fc-4c79-a325-443609e4a349 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:00.380541 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e298fb-b9fc-4c79-a325-443609e4a349 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:00.415065 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242c1a9-a146-4dbe-92f6-e742dd190659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:00.415651 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242c1a9-a146-4dbe-92f6-e742dd190659 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:00.415936 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242c1a9-a146-4dbe-92f6-e742dd190659 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:00.416204 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242c1a9-a146-4dbe-92f6-e742dd190659 None admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:00.416854 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242c1a9-a146-4dbe-92f6-e742dd190659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:17:00.417154 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242c1a9-a146-4dbe-92f6-e742dd190659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:00.418528 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242c1a9-a146-4dbe-92f6-e742dd190659 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:00.429618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 437/905] 10.222.0.43 () {56 vars in 1109 bytes} [Sat Sep 3 21:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:17:00.435669 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26f53d-554d-4da3-8d5e-7216b9609d3d None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:00.536798 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26f53d-554d-4da3-8d5e-7216b9609d3d None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:00.551621 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:00.572322 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538af8d-5061-44c0-8c9c-8c90c438fb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:00.572985 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538af8d-5061-44c0-8c9c-8c90c438fb5f None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:00.573272 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538af8d-5061-44c0-8c9c-8c90c438fb5f None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:00.573559 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538af8d-5061-44c0-8c9c-8c90c438fb5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:00.580099 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538af8d-5061-44c0-8c9c-8c90c438fb5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:00.581580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538af8d-5061-44c0-8c9c-8c90c438fb5f None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application [None req-6538af8d-5061-44c0-8c9c-8c90c438fb5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 03 21:17:00.593234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application with Lock( Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:17:00.598282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:17:00.599387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 03 21:17:00.599387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 03 21:17:00.599387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 03 21:17:00.599387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 03 21:17:00.599387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 03 21:17:00.599387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 03 21:17:00.599387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 03 21:17:00.599387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: ERROR keystone.server.flask.application Sep 03 21:17:00.599387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 469/906] 10.222.0.43 () {56 vars in 1111 bytes} [Sat Sep 3 21:17:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:17:00.600633 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242c1a9-a146-4dbe-92f6-e742dd190659 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:00.649840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:00.704337 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242c1a9-a146-4dbe-92f6-e742dd190659 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:00.737247 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a6cc8-486b-48f3-b3af-bbb3b8b5eb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:00.738777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6cc8-486b-48f3-b3af-bbb3b8b5eb9e None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:00.738777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6cc8-486b-48f3-b3af-bbb3b8b5eb9e None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:00.738777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6cc8-486b-48f3-b3af-bbb3b8b5eb9e None admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:00.739084 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a6cc8-486b-48f3-b3af-bbb3b8b5eb9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:17:00.739340 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a6cc8-486b-48f3-b3af-bbb3b8b5eb9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:00.740821 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a6cc8-486b-48f3-b3af-bbb3b8b5eb9e None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:00.753153 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 438/907] 10.222.0.43 () {56 vars in 1148 bytes} [Sat Sep 3 21:17:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:17:00.760150 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538af8d-5061-44c0-8c9c-8c90c438fb5f None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:00.865365 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538af8d-5061-44c0-8c9c-8c90c438fb5f None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:00.900563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66093139-6cb1-44cc-be82-6cf07b04db11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:00.901176 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093139-6cb1-44cc-be82-6cf07b04db11 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:00.901459 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093139-6cb1-44cc-be82-6cf07b04db11 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:00.901989 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66093139-6cb1-44cc-be82-6cf07b04db11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:00.902704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66093139-6cb1-44cc-be82-6cf07b04db11 None admin] RBAC: Adding query filter params (role.id=a1c22a1558c34c1d9d262bf1da31887e, scope.project.id=3bae29e3189d480c9200f03128f0c607, user.id=5fb45f9358b64974a39d996e93e5c105) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:17:00.903088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66093139-6cb1-44cc-be82-6cf07b04db11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:00.904620 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66093139-6cb1-44cc-be82-6cf07b04db11 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:00.910461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 470/908] 10.222.0.43 () {56 vars in 1374 bytes} [Sat Sep 3 21:17:00 2022] GET /identity/v3/role_assignments?user.id=5fb45f9358b64974a39d996e93e5c105&scope.project.id=3bae29e3189d480c9200f03128f0c607&role.id=a1c22a1558c34c1d9d262bf1da31887e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:17:03.156122 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cbcb9-35ff-4364-896d-e5f190aa069b None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:03.156670 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cbcb9-35ff-4364-896d-e5f190aa069b None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:03.156670 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cbcb9-35ff-4364-896d-e5f190aa069b None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:03.158038 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 439/909] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:17:03.163121 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88c4f8-ffc2-4c3e-92b5-c2fbdc78c8a0 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:03.163530 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88c4f8-ffc2-4c3e-92b5-c2fbdc78c8a0 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:03.163667 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88c4f8-ffc2-4c3e-92b5-c2fbdc78c8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:03.182581 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-ff88c4f8-ffc2-4c3e-92b5-c2fbdc78c8a0 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:17:03.183919 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-ff88c4f8-ffc2-4c3e-92b5-c2fbdc78c8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:17:03.214282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:03.251548 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 471/910] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:17:03 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:17:03.588436 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cbcb9-35ff-4364-896d-e5f190aa069b None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:03.693461 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cbcb9-35ff-4364-896d-e5f190aa069b None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:03.700646 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:03.727387 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d1253-76c8-4383-ba60-198617f4f477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:03.728068 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d1253-76c8-4383-ba60-198617f4f477 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:03.728349 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d1253-76c8-4383-ba60-198617f4f477 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:03.728649 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d1253-76c8-4383-ba60-198617f4f477 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:03.729223 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d1253-76c8-4383-ba60-198617f4f477 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:03.730595 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098d1253-76c8-4383-ba60-198617f4f477 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-098d1253-76c8-4383-ba60-198617f4f477 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:17:03.739819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:17:03.741128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:17:03.742277 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 440/911] 10.222.0.43 () {56 vars in 1117 bytes} [Sat Sep 3 21:17:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:17:03.748054 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88c4f8-ffc2-4c3e-92b5-c2fbdc78c8a0 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:03.849717 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88c4f8-ffc2-4c3e-92b5-c2fbdc78c8a0 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:03.884439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac37be-3e35-4231-8de3-e82dd7b01f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:03.885069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac37be-3e35-4231-8de3-e82dd7b01f9f None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:03.885350 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac37be-3e35-4231-8de3-e82dd7b01f9f None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:03.885657 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac37be-3e35-4231-8de3-e82dd7b01f9f None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:03.886313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac37be-3e35-4231-8de3-e82dd7b01f9f None admin] RBAC: Adding query filter params (name=placement) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:17:03.886618 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac37be-3e35-4231-8de3-e82dd7b01f9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:03.888020 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac37be-3e35-4231-8de3-e82dd7b01f9f None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:03.892763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 472/912] 10.222.0.43 () {56 vars in 1116 bytes} [Sat Sep 3 21:17:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:17:03.899194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d1253-76c8-4383-ba60-198617f4f477 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:04.000946 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d1253-76c8-4383-ba60-198617f4f477 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:04.036088 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4cdfc-ecfa-45ce-a0aa-eb1ac6d964bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:04.036731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4cdfc-ecfa-45ce-a0aa-eb1ac6d964bf None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:04.037014 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4cdfc-ecfa-45ce-a0aa-eb1ac6d964bf None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:04.037289 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4cdfc-ecfa-45ce-a0aa-eb1ac6d964bf None admin] PATH_INFO: `/v3/services` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:04.037910 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4cdfc-ecfa-45ce-a0aa-eb1ac6d964bf None admin] RBAC: Adding query filter params (type=placement) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:17:04.038216 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4cdfc-ecfa-45ce-a0aa-eb1ac6d964bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:04.040376 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4cdfc-ecfa-45ce-a0aa-eb1ac6d964bf None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:04.044829 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 441/913] 10.222.0.43 () {56 vars in 1116 bytes} [Sat Sep 3 21:17:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:17:06.228557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fef77-1695-411a-8e83-02d4828cfbef None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:06.229100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fef77-1695-411a-8e83-02d4828cfbef None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:06.229193 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fef77-1695-411a-8e83-02d4828cfbef None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:06.230554 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 473/914] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:17:06.235676 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e4d22-aa28-4196-89ca-de13d416861a None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:06.236117 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e4d22-aa28-4196-89ca-de13d416861a None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:06.236265 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e4d22-aa28-4196-89ca-de13d416861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:06.254447 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-b22e4d22-aa28-4196-89ca-de13d416861a None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:17:06.255608 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-b22e4d22-aa28-4196-89ca-de13d416861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:17:06.282367 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:06.321411 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 442/915] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:17:06 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:17:06.652389 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fef77-1695-411a-8e83-02d4828cfbef None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:06.683713 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:06.754460 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fef77-1695-411a-8e83-02d4828cfbef None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:06.789222 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97464b8-f6cd-4e45-89b5-06ed4c2da4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:06.789891 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97464b8-f6cd-4e45-89b5-06ed4c2da4d7 None admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:06.790205 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97464b8-f6cd-4e45-89b5-06ed4c2da4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:06.790442 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97464b8-f6cd-4e45-89b5-06ed4c2da4d7 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:06.791100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97464b8-f6cd-4e45-89b5-06ed4c2da4d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:06.792484 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97464b8-f6cd-4e45-89b5-06ed4c2da4d7 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:06.906242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 474/916] 10.222.0.43 () {60 vars in 1141 bytes} [Sat Sep 3 21:17:06 2022] POST /identity/v3/services => generated 246 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:17:09.164216 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d783122-2fb7-4905-8def-195db1405ef4 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:09.164818 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d783122-2fb7-4905-8def-195db1405ef4 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:09.165182 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d783122-2fb7-4905-8def-195db1405ef4 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:09.166646 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 443/917] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:17:09.171825 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466292b-3089-4ade-99d5-ef38c4e96228 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:09.172242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466292b-3089-4ade-99d5-ef38c4e96228 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:09.172348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466292b-3089-4ade-99d5-ef38c4e96228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:09.191115 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-a466292b-3089-4ade-99d5-ef38c4e96228 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:17:09.192282 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-a466292b-3089-4ade-99d5-ef38c4e96228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:17:09.267136 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 475/918] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:17:09 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:17:09.596397 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d783122-2fb7-4905-8def-195db1405ef4 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:09.700925 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d783122-2fb7-4905-8def-195db1405ef4 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:09.734656 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f54369-3615-4e3c-a787-eeefa3c33250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:09.735275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f54369-3615-4e3c-a787-eeefa3c33250 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:09.735557 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f54369-3615-4e3c-a787-eeefa3c33250 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:09.735833 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f54369-3615-4e3c-a787-eeefa3c33250 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:09.736407 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f54369-3615-4e3c-a787-eeefa3c33250 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:09.737853 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f54369-3615-4e3c-a787-eeefa3c33250 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-38f54369-3615-4e3c-a787-eeefa3c33250 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:17:09.747273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:17:09.748465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:17:09.749714 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 444/919] 10.222.0.43 () {56 vars in 1117 bytes} [Sat Sep 3 21:17:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:17:09.754652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466292b-3089-4ade-99d5-ef38c4e96228 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:09.775823 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:09.856885 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466292b-3089-4ade-99d5-ef38c4e96228 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:09.890780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0170c-2c35-4756-9237-90df4fb53426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:09.891374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0170c-2c35-4756-9237-90df4fb53426 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:09.891694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0170c-2c35-4756-9237-90df4fb53426 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:09.891965 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0170c-2c35-4756-9237-90df4fb53426 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:09.892632 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0170c-2c35-4756-9237-90df4fb53426 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:17:09.892908 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0170c-2c35-4756-9237-90df4fb53426 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:09.894272 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0170c-2c35-4756-9237-90df4fb53426 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:09.899639 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 476/920] 10.222.0.43 () {56 vars in 1116 bytes} [Sat Sep 3 21:17:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:17:09.905931 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f54369-3615-4e3c-a787-eeefa3c33250 None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:09.936213 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:10.027443 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f54369-3615-4e3c-a787-eeefa3c33250 None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:10.063678 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a0c47-3b06-4eab-a0d6-70bcef08dc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:10.064288 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a0c47-3b06-4eab-a0d6-70bcef08dc79 None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:10.064597 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a0c47-3b06-4eab-a0d6-70bcef08dc79 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:10.064878 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a0c47-3b06-4eab-a0d6-70bcef08dc79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:10.065579 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a0c47-3b06-4eab-a0d6-70bcef08dc79 None admin] RBAC: Adding query filter params (interface=public, service_id=275226a13a10470d966299bce96dcd68, region_id=RegionOne) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:17:10.065893 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a0c47-3b06-4eab-a0d6-70bcef08dc79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:10.067300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a0c47-3b06-4eab-a0d6-70bcef08dc79 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:10.073508 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 445/921] 10.222.0.43 () {56 vars in 1251 bytes} [Sat Sep 3 21:17:09 2022] GET /identity/v3/endpoints?service_id=275226a13a10470d966299bce96dcd68&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:17:10.079534 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0170c-2c35-4756-9237-90df4fb53426 None admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:10.168864 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:10.190379 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0170c-2c35-4756-9237-90df4fb53426 None admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:10.225088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cc78a-c2bc-4a69-b475-99141ee23ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:10.225698 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cc78a-c2bc-4a69-b475-99141ee23ee0 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:10.225981 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cc78a-c2bc-4a69-b475-99141ee23ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:10.226259 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cc78a-c2bc-4a69-b475-99141ee23ee0 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:10.227664 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cc78a-c2bc-4a69-b475-99141ee23ee0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:10.229272 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cc78a-c2bc-4a69-b475-99141ee23ee0 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:10.239033 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 477/922] 10.222.0.43 () {56 vars in 1087 bytes} [Sat Sep 3 21:17:10 2022] GET /identity/v3/services => generated 1962 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 21:17:12.470586 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94375eb4-e7c3-4928-b8b4-bfb65c682cc8 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:12.471174 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94375eb4-e7c3-4928-b8b4-bfb65c682cc8 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:12.471174 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94375eb4-e7c3-4928-b8b4-bfb65c682cc8 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:12.472450 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 446/923] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:17:12.477966 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c332f6a-32d5-4ea8-a459-da2015e923bb None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:12.478373 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c332f6a-32d5-4ea8-a459-da2015e923bb None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:12.478513 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c332f6a-32d5-4ea8-a459-da2015e923bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:12.500032 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-6c332f6a-32d5-4ea8-a459-da2015e923bb None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:17:12.501255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-6c332f6a-32d5-4ea8-a459-da2015e923bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:17:12.570295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 478/924] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:17:12 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 03 21:17:12.909917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94375eb4-e7c3-4928-b8b4-bfb65c682cc8 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:13.006552 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:13.016585 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94375eb4-e7c3-4928-b8b4-bfb65c682cc8 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:13.051754 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a7c28-eac0-4491-b19f-f7ea6a6e912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:13.052398 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a7c28-eac0-4491-b19f-f7ea6a6e912b None admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:13.052707 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a7c28-eac0-4491-b19f-f7ea6a6e912b None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:13.052980 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a7c28-eac0-4491-b19f-f7ea6a6e912b None admin] PATH_INFO: `/v3/services/placement` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:13.053562 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a7c28-eac0-4491-b19f-f7ea6a6e912b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:13.054948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a7c28-eac0-4491-b19f-f7ea6a6e912b None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application [None req-df9a7c28-eac0-4491-b19f-f7ea6a6e912b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 03 21:17:13.063933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 03 21:17:13.068563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.get_or_create( Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application with Lock( Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self._enter() Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application return self.creator() Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application created_value = creator( Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: ERROR keystone.server.flask.application Sep 03 21:17:13.069618 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 447/925] 10.222.0.43 () {56 vars in 1117 bytes} [Sat Sep 3 21:17:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 03 21:17:13.071387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c332f6a-32d5-4ea8-a459-da2015e923bb None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:13.151722 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:13.174405 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c332f6a-32d5-4ea8-a459-da2015e923bb None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:13.206804 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134b731-a1fa-4c07-b90b-17d816840249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:13.207398 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b731-a1fa-4c07-b90b-17d816840249 None admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:13.207677 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b731-a1fa-4c07-b90b-17d816840249 None admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:13.207947 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134b731-a1fa-4c07-b90b-17d816840249 None admin] PATH_INFO: `/v3/services` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:13.208590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134b731-a1fa-4c07-b90b-17d816840249 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:17:13.208894 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134b731-a1fa-4c07-b90b-17d816840249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:13.210247 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134b731-a1fa-4c07-b90b-17d816840249 None admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:13.216504 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 479/926] 10.222.0.43 () {56 vars in 1116 bytes} [Sat Sep 3 21:17:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:17:13.222585 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a7c28-eac0-4491-b19f-f7ea6a6e912b None admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:17:13.326103 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a7c28-eac0-4491-b19f-f7ea6a6e912b None admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:17:13.360246 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52ffa0-19ba-451e-b78d-476b5e96c2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:17:13.360872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52ffa0-19ba-451e-b78d-476b5e96c2e0 None admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:17:13.361151 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52ffa0-19ba-451e-b78d-476b5e96c2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:17:13.361424 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52ffa0-19ba-451e-b78d-476b5e96c2e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:17:13.362080 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52ffa0-19ba-451e-b78d-476b5e96c2e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:17:13.363447 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52ffa0-19ba-451e-b78d-476b5e96c2e0 None admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:17:13.488121 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 448/927] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Sep 3 21:17:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:17:23.214710 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=30 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:17:23.483253 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:24:51.327930 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a78cd-b8a4-4a8a-99a2-a04f9eda152b None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:24:51.327930 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a78cd-b8a4-4a8a-99a2-a04f9eda152b None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:24:51.327930 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a78cd-b8a4-4a8a-99a2-a04f9eda152b None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:24:51.330152 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 480/928] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:24:51.333945 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43691bcf-e973-4790-b144-0253d5dc722b None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:24:51.334416 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43691bcf-e973-4790-b144-0253d5dc722b None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:24:51.335027 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43691bcf-e973-4790-b144-0253d5dc722b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:24:51.454155 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-43691bcf-e973-4790-b144-0253d5dc722b None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:24:51.455561 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-43691bcf-e973-4790-b144-0253d5dc722b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:24:51.613006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 449/929] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:24:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:24:51.985367 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e9c07-ca9d-4f87-ae8d-6fa513105bee None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:24:51.985688 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e9c07-ca9d-4f87-ae8d-6fa513105bee None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:24:51.985905 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e9c07-ca9d-4f87-ae8d-6fa513105bee None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:24:51.987317 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 481/930] 10.222.0.43 () {54 vars in 965 bytes} [Sat Sep 3 21:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:24:51.998850 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebd526-6e01-4d59-8f46-6877b91e915a None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:24:51.999329 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebd526-6e01-4d59-8f46-6877b91e915a None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:24:51.999797 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebd526-6e01-4d59-8f46-6877b91e915a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:24:52.099654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-8cebd526-6e01-4d59-8f46-6877b91e915a None None] MFA Rules not processed for user `a969a77183c34a7e9eff28636b1170c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:24:52.100701 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-8cebd526-6e01-4d59-8f46-6877b91e915a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:24:52.142372 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:24:52.203378 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 450/931] 10.222.0.43 () {58 vars in 1062 bytes} [Sat Sep 3 21:24:51 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:24:52.214084 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e9c07-ca9d-4f87-ae8d-6fa513105bee None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:24:52.233095 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e9c07-ca9d-4f87-ae8d-6fa513105bee None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:24:52.237557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f10e6-19a5-494d-9c7b-ad2005338f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:24:52.238446 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f10e6-19a5-494d-9c7b-ad2005338f72 service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:24:52.238887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f10e6-19a5-494d-9c7b-ad2005338f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:24:52.239323 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f10e6-19a5-494d-9c7b-ad2005338f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:24:52.250797 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f10e6-19a5-494d-9c7b-ad2005338f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:24:52.252488 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f10e6-19a5-494d-9c7b-ad2005338f72 service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:24:52.264712 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 482/932] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:24:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:24:54.753335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e3be8-9dff-4645-8657-d8b5516582b3 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:24:54.753913 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e3be8-9dff-4645-8657-d8b5516582b3 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:24:54.753913 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e3be8-9dff-4645-8657-d8b5516582b3 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:24:54.755203 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 451/933] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:24:54.761114 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec292e80-fe87-48ff-83d2-7a5bf12fd7b1 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:24:54.761114 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec292e80-fe87-48ff-83d2-7a5bf12fd7b1 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:24:54.762371 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec292e80-fe87-48ff-83d2-7a5bf12fd7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:24:54.782735 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-ec292e80-fe87-48ff-83d2-7a5bf12fd7b1 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:24:54.784037 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-ec292e80-fe87-48ff-83d2-7a5bf12fd7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:24:54.791964 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 483/934] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:24:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:24:55.129588 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e3be8-9dff-4645-8657-d8b5516582b3 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:24:55.141519 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e3be8-9dff-4645-8657-d8b5516582b3 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:24:55.145573 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0cec0-2059-4c64-8687-946d8a0a3c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:24:55.146333 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0cec0-2059-4c64-8687-946d8a0a3c82 service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:24:55.146673 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0cec0-2059-4c64-8687-946d8a0a3c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:24:55.147006 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0cec0-2059-4c64-8687-946d8a0a3c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:24:55.157465 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0cec0-2059-4c64-8687-946d8a0a3c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:24:55.158973 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0cec0-2059-4c64-8687-946d8a0a3c82 service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:24:55.170362 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 452/935] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:24:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:24:57.957106 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429287b-d560-48ae-8660-c72c122e4ad4 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:24:57.957637 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429287b-d560-48ae-8660-c72c122e4ad4 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:24:57.957637 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429287b-d560-48ae-8660-c72c122e4ad4 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:24:57.958979 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 484/936] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:24:57.964129 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32d8f2-7b4d-4410-8602-108c9904a2e2 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:24:57.964915 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32d8f2-7b4d-4410-8602-108c9904a2e2 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:24:57.964915 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32d8f2-7b4d-4410-8602-108c9904a2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:24:58.028273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-4c32d8f2-7b4d-4410-8602-108c9904a2e2 None None] MFA Rules not processed for user `56fbb9dd45de404382c3e037536a513e`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:24:58.029538 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-4c32d8f2-7b4d-4410-8602-108c9904a2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:24:58.126020 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 453/937] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:24:57 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:24:58.482685 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023e77f-c650-41bd-8736-1ddf71e49f50 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:24:58.482953 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023e77f-c650-41bd-8736-1ddf71e49f50 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:24:58.483222 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023e77f-c650-41bd-8736-1ddf71e49f50 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:24:58.484574 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 485/938] 10.222.0.43 () {54 vars in 965 bytes} [Sat Sep 3 21:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:24:58.490697 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324bb86-a41e-4c2e-8b0c-626d175d94c3 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:24:58.490985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324bb86-a41e-4c2e-8b0c-626d175d94c3 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:24:58.491257 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324bb86-a41e-4c2e-8b0c-626d175d94c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:24:58.511633 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-a324bb86-a41e-4c2e-8b0c-626d175d94c3 None None] MFA Rules not processed for user `a969a77183c34a7e9eff28636b1170c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:24:58.512772 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-a324bb86-a41e-4c2e-8b0c-626d175d94c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:24:58.519087 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 454/939] 10.222.0.43 () {58 vars in 1062 bytes} [Sat Sep 3 21:24:58 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:24:58.529042 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023e77f-c650-41bd-8736-1ddf71e49f50 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:24:58.540203 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023e77f-c650-41bd-8736-1ddf71e49f50 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:24:58.544402 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42eaa7-955b-4cea-a4a8-596a4fd2c1c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:24:58.545025 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42eaa7-955b-4cea-a4a8-596a4fd2c1c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:24:58.545307 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42eaa7-955b-4cea-a4a8-596a4fd2c1c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:24:58.545640 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42eaa7-955b-4cea-a4a8-596a4fd2c1c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:24:58.554776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42eaa7-955b-4cea-a4a8-596a4fd2c1c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:24:58.556264 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42eaa7-955b-4cea-a4a8-596a4fd2c1c1 service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:24:58.566306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 486/940] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:24:58 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:25:01.975670 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fadadd-a8af-4015-97a6-83927f4bf5e7 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:01.976230 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fadadd-a8af-4015-97a6-83927f4bf5e7 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:01.976230 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fadadd-a8af-4015-97a6-83927f4bf5e7 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:01.977573 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 455/941] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:01.989736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e726b-ff36-4cac-b992-62add53d8dcc None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:01.989736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e726b-ff36-4cac-b992-62add53d8dcc None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:01.989736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e726b-ff36-4cac-b992-62add53d8dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:02.003507 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-736e726b-ff36-4cac-b992-62add53d8dcc None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:02.004746 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-736e726b-ff36-4cac-b992-62add53d8dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:02.083038 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 487/942] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:25:01 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:02.430478 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fadadd-a8af-4015-97a6-83927f4bf5e7 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:25:02.441634 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fadadd-a8af-4015-97a6-83927f4bf5e7 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:25:02.445357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b0de0-e389-461b-92ee-02072eebeb5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:25:02.445955 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b0de0-e389-461b-92ee-02072eebeb5e service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:02.446236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b0de0-e389-461b-92ee-02072eebeb5e service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:02.446508 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b0de0-e389-461b-92ee-02072eebeb5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:02.456727 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b0de0-e389-461b-92ee-02072eebeb5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:25:02.458172 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b0de0-e389-461b-92ee-02072eebeb5e service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:25:02.468704 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 456/943] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:25:02 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:25:05.681620 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e332ab-beca-4737-932a-7bd89c2e6e66 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:05.682183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e332ab-beca-4737-932a-7bd89c2e6e66 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:05.682183 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e332ab-beca-4737-932a-7bd89c2e6e66 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:05.684304 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 488/944] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:05.689800 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfd76a-9aa9-4d61-b0af-8d08e0f67731 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:05.690267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfd76a-9aa9-4d61-b0af-8d08e0f67731 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:05.690375 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfd76a-9aa9-4d61-b0af-8d08e0f67731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:05.711566 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-bddfd76a-9aa9-4d61-b0af-8d08e0f67731 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:05.712813 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-bddfd76a-9aa9-4d61-b0af-8d08e0f67731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:05.721024 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 457/945] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:25:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 21:25:06.065201 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e332ab-beca-4737-932a-7bd89c2e6e66 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:25:06.076127 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e332ab-beca-4737-932a-7bd89c2e6e66 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:25:06.079886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c5d04-0104-4229-9ee7-c743a5539ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:25:06.080493 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c5d04-0104-4229-9ee7-c743a5539ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:06.080806 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c5d04-0104-4229-9ee7-c743a5539ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:06.081144 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c5d04-0104-4229-9ee7-c743a5539ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:06.090810 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c5d04-0104-4229-9ee7-c743a5539ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:25:06.092256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c5d04-0104-4229-9ee7-c743a5539ce3 service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:25:06.102830 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 489/946] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:25:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:25:08.392207 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a030-644d-4630-8fe4-3cf0345b05f5 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:08.392789 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a030-644d-4630-8fe4-3cf0345b05f5 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:08.392789 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5a030-644d-4630-8fe4-3cf0345b05f5 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:08.394478 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 458/947] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:08.400238 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f4860-077a-4970-8238-21ea9009844d None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:08.400870 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f4860-077a-4970-8238-21ea9009844d None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:08.401060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f4860-077a-4970-8238-21ea9009844d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:08.421978 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-8b6f4860-077a-4970-8238-21ea9009844d None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:08.423017 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-8b6f4860-077a-4970-8238-21ea9009844d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:08.431234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 490/948] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:25:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:08.774101 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5a030-644d-4630-8fe4-3cf0345b05f5 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:25:08.785945 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5a030-644d-4630-8fe4-3cf0345b05f5 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:25:08.789401 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac693034-1444-48a4-a2e0-c54e5c73fa9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:25:08.790003 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac693034-1444-48a4-a2e0-c54e5c73fa9f service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:08.790271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac693034-1444-48a4-a2e0-c54e5c73fa9f service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:08.790539 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac693034-1444-48a4-a2e0-c54e5c73fa9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:08.800766 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac693034-1444-48a4-a2e0-c54e5c73fa9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:25:08.802199 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac693034-1444-48a4-a2e0-c54e5c73fa9f service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:25:08.812321 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 459/949] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:25:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:25:11.094638 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ca7f-7312-418b-9b10-2e13ab2200f6 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:11.095190 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ca7f-7312-418b-9b10-2e13ab2200f6 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:11.095190 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ca7f-7312-418b-9b10-2e13ab2200f6 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:11.096497 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 491/950] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:11.101623 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2555-e6c6-456b-9755-94bfd260f947 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:11.102079 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2555-e6c6-456b-9755-94bfd260f947 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:11.102170 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d2555-e6c6-456b-9755-94bfd260f947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:11.121954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-788d2555-e6c6-456b-9755-94bfd260f947 None None] MFA Rules not processed for user `56fbb9dd45de404382c3e037536a513e`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:11.123191 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-788d2555-e6c6-456b-9755-94bfd260f947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:11.131044 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 460/951] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:25:11 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:11.470090 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8ca7f-7312-418b-9b10-2e13ab2200f6 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:25:11.488137 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8ca7f-7312-418b-9b10-2e13ab2200f6 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:25:11.491650 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df8a6e-26e0-4c11-bc61-a5d10716b891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:25:11.492258 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df8a6e-26e0-4c11-bc61-a5d10716b891 service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:11.492551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df8a6e-26e0-4c11-bc61-a5d10716b891 service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:11.492892 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df8a6e-26e0-4c11-bc61-a5d10716b891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:11.503510 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df8a6e-26e0-4c11-bc61-a5d10716b891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:25:11.505008 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df8a6e-26e0-4c11-bc61-a5d10716b891 service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:25:11.515545 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 492/952] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:25:11 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:25:14.203198 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7b8a5-b244-4864-a38a-112e56ae0e38 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:14.203731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7b8a5-b244-4864-a38a-112e56ae0e38 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:14.203731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7b8a5-b244-4864-a38a-112e56ae0e38 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:14.205103 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 461/953] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:14.210535 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91e61e-9f19-4eda-9ae2-3bb610dcf2ca None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:14.211149 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91e61e-9f19-4eda-9ae2-3bb610dcf2ca None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:14.211149 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91e61e-9f19-4eda-9ae2-3bb610dcf2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:14.218824 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=62 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:25:14.238895 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-bf91e61e-9f19-4eda-9ae2-3bb610dcf2ca None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:14.240102 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-bf91e61e-9f19-4eda-9ae2-3bb610dcf2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:14.248652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 493/954] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:25:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:14.600254 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7b8a5-b244-4864-a38a-112e56ae0e38 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:25:14.608157 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:25:14.613048 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7b8a5-b244-4864-a38a-112e56ae0e38 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:25:14.616712 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64352d62-95a4-484c-bf9d-51bdb33b1892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:25:14.621371 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64352d62-95a4-484c-bf9d-51bdb33b1892 service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:14.621371 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64352d62-95a4-484c-bf9d-51bdb33b1892 service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:14.621371 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64352d62-95a4-484c-bf9d-51bdb33b1892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:14.629158 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64352d62-95a4-484c-bf9d-51bdb33b1892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:25:14.630884 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64352d62-95a4-484c-bf9d-51bdb33b1892 service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:25:14.642573 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 462/955] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:25:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:25:16.945225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83e67f-6d8c-48cb-860c-6afea6161468 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:16.945769 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83e67f-6d8c-48cb-860c-6afea6161468 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:16.945769 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83e67f-6d8c-48cb-860c-6afea6161468 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:16.947128 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 494/956] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:16.953795 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc0da8-2f69-4905-a901-9419153bb6fe None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:16.954239 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc0da8-2f69-4905-a901-9419153bb6fe None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:16.954329 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc0da8-2f69-4905-a901-9419153bb6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:16.974715 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-47cc0da8-2f69-4905-a901-9419153bb6fe None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:16.975898 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-47cc0da8-2f69-4905-a901-9419153bb6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:16.984515 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 463/957] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:25:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:17.332464 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83e67f-6d8c-48cb-860c-6afea6161468 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:25:17.344710 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83e67f-6d8c-48cb-860c-6afea6161468 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:25:17.348868 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a98809-6762-4b5e-8e1d-60d46b2682a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:25:17.349782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a98809-6762-4b5e-8e1d-60d46b2682a5 service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:17.349960 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a98809-6762-4b5e-8e1d-60d46b2682a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:17.350237 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a98809-6762-4b5e-8e1d-60d46b2682a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:17.365126 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a98809-6762-4b5e-8e1d-60d46b2682a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:25:17.367268 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a98809-6762-4b5e-8e1d-60d46b2682a5 service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:25:17.377650 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 495/958] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:25:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:25:20.189893 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3cf21-6e3b-45d5-8ee6-74a53743bf35 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:20.190430 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3cf21-6e3b-45d5-8ee6-74a53743bf35 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:20.190430 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3cf21-6e3b-45d5-8ee6-74a53743bf35 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:20.191786 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 464/959] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:20.197278 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f60a64-03f5-4b02-b09c-6dcea15a4ac3 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:20.198007 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f60a64-03f5-4b02-b09c-6dcea15a4ac3 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:20.198192 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f60a64-03f5-4b02-b09c-6dcea15a4ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:20.218919 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-46f60a64-03f5-4b02-b09c-6dcea15a4ac3 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:20.220143 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-46f60a64-03f5-4b02-b09c-6dcea15a4ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:20.227915 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 496/960] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:25:20 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:20.575418 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3cf21-6e3b-45d5-8ee6-74a53743bf35 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:25:20.586166 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3cf21-6e3b-45d5-8ee6-74a53743bf35 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:25:20.590680 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806a4a8-475a-4019-b5c5-9a776f11d629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:25:20.591274 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806a4a8-475a-4019-b5c5-9a776f11d629 service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:20.591555 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806a4a8-475a-4019-b5c5-9a776f11d629 service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:20.591826 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806a4a8-475a-4019-b5c5-9a776f11d629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:20.600898 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806a4a8-475a-4019-b5c5-9a776f11d629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:25:20.602335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806a4a8-475a-4019-b5c5-9a776f11d629 service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:25:20.611917 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 465/961] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:25:20 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:25:25.162093 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1851a79-7b5c-4756-aec5-88894bf84737 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:25.162660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1851a79-7b5c-4756-aec5-88894bf84737 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:25.162660 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1851a79-7b5c-4756-aec5-88894bf84737 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:25.163986 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 497/962] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:25:25.170180 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e2240-56db-4baf-ab6b-6bf8cd11d98c None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:25.170726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e2240-56db-4baf-ab6b-6bf8cd11d98c None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:25.170726 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e2240-56db-4baf-ab6b-6bf8cd11d98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:25.191974 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-923e2240-56db-4baf-ab6b-6bf8cd11d98c None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:25.193221 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-923e2240-56db-4baf-ab6b-6bf8cd11d98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:25.201841 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 466/963] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:25:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:25.553965 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1851a79-7b5c-4756-aec5-88894bf84737 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:25:25.565058 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1851a79-7b5c-4756-aec5-88894bf84737 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:25:25.568696 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9649a4-4b4d-4827-bdca-754a7e1d87b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:25:25.569390 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9649a4-4b4d-4827-bdca-754a7e1d87b6 service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:25.569600 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9649a4-4b4d-4827-bdca-754a7e1d87b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:25.569893 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9649a4-4b4d-4827-bdca-754a7e1d87b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:25.580280 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9649a4-4b4d-4827-bdca-754a7e1d87b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:25:25.581778 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9649a4-4b4d-4827-bdca-754a7e1d87b6 service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:25:25.592305 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 498/964] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:25:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:25:29.070703 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb835920-630e-472d-a765-308e9b96d02f None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:29.071596 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb835920-630e-472d-a765-308e9b96d02f None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:29.071596 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb835920-630e-472d-a765-308e9b96d02f None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:29.072927 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 467/965] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:29.078636 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165bd0b-2eae-45a9-910e-710868ffc72d None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:29.079122 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165bd0b-2eae-45a9-910e-710868ffc72d None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:29.079336 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165bd0b-2eae-45a9-910e-710868ffc72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:29.100680 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-c165bd0b-2eae-45a9-910e-710868ffc72d None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:29.101908 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-c165bd0b-2eae-45a9-910e-710868ffc72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:29.110614 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 499/966] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:25:29 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:29.457099 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb835920-630e-472d-a765-308e9b96d02f None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:25:29.469090 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb835920-630e-472d-a765-308e9b96d02f None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:25:29.472779 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b1316-9850-4e6c-8886-5b5b0b5fa8bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:25:29.473379 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1316-9850-4e6c-8886-5b5b0b5fa8bf service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:29.473661 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1316-9850-4e6c-8886-5b5b0b5fa8bf service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:29.473933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b1316-9850-4e6c-8886-5b5b0b5fa8bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:29.483850 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b1316-9850-4e6c-8886-5b5b0b5fa8bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:25:29.485363 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b1316-9850-4e6c-8886-5b5b0b5fa8bf service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:25:29.495725 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 468/967] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:25:29 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:25:34.404018 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f046e-3718-4523-9bce-8e57ea1c44eb None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:34.404738 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f046e-3718-4523-9bce-8e57ea1c44eb None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:34.404738 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f046e-3718-4523-9bce-8e57ea1c44eb None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:34.405973 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 500/968] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:34.411796 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e624d07-7cfc-407d-8d11-deac31306a09 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:34.414494 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e624d07-7cfc-407d-8d11-deac31306a09 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:34.414494 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e624d07-7cfc-407d-8d11-deac31306a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:34.435132 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-7e624d07-7cfc-407d-8d11-deac31306a09 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:34.436409 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-7e624d07-7cfc-407d-8d11-deac31306a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:34.444405 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 469/969] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:25:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:34.815777 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f046e-3718-4523-9bce-8e57ea1c44eb None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:25:34.829914 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f046e-3718-4523-9bce-8e57ea1c44eb None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:25:34.833465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253695f2-a2f4-4c29-ad3b-5ef7bb163def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:25:34.834023 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253695f2-a2f4-4c29-ad3b-5ef7bb163def service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:34.834303 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253695f2-a2f4-4c29-ad3b-5ef7bb163def service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:34.834578 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253695f2-a2f4-4c29-ad3b-5ef7bb163def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:34.845031 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253695f2-a2f4-4c29-ad3b-5ef7bb163def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:25:34.846490 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253695f2-a2f4-4c29-ad3b-5ef7bb163def service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:25:34.856892 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 501/970] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:25:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:25:40.616503 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81504c06-af1f-4202-9193-ad698f6d1539 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:40.617017 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81504c06-af1f-4202-9193-ad698f6d1539 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:40.617017 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81504c06-af1f-4202-9193-ad698f6d1539 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:40.618363 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 470/971] 10.222.0.43 () {54 vars in 921 bytes} [Sat Sep 3 21:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:40.624005 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5b4bd-34f6-4cea-8c14-cb9ec9321c01 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:40.624513 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5b4bd-34f6-4cea-8c14-cb9ec9321c01 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:40.626461 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5b4bd-34f6-4cea-8c14-cb9ec9321c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:40.700081 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-9cf5b4bd-34f6-4cea-8c14-cb9ec9321c01 None None] MFA Rules not processed for user `5fb45f9358b64974a39d996e93e5c105`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:40.701904 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-9cf5b4bd-34f6-4cea-8c14-cb9ec9321c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:40.789747 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 502/972] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Sep 3 21:25:40 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:44.428388 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=25 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:25:45.401204 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13beb05-b4a4-44cd-a909-aff09c017cd3 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:45.401673 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13beb05-b4a4-44cd-a909-aff09c017cd3 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:45.402018 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13beb05-b4a4-44cd-a909-aff09c017cd3 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:45.404077 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 471/973] 10.222.0.43 () {54 vars in 921 bytes} [Sat Sep 3 21:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:45.409081 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180d710-428c-4012-9a5b-c93824ac16a6 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:45.409565 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180d710-428c-4012-9a5b-c93824ac16a6 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:45.409909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180d710-428c-4012-9a5b-c93824ac16a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:45.418500 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=66 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:25:45.432955 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-4180d710-428c-4012-9a5b-c93824ac16a6 None None] MFA Rules not processed for user `5fb45f9358b64974a39d996e93e5c105`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:45.434167 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-4180d710-428c-4012-9a5b-c93824ac16a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:45.443397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 503/974] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Sep 3 21:25:45 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:47.127888 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f2cdc-54a5-4437-a1e8-ce9a6ae2f53d None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:47.128403 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f2cdc-54a5-4437-a1e8-ce9a6ae2f53d None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:47.128562 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f2cdc-54a5-4437-a1e8-ce9a6ae2f53d None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:47.129972 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 472/975] 10.222.0.43 () {54 vars in 921 bytes} [Sat Sep 3 21:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:47.135793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e5af9-b0dd-4032-99ab-a9ecf964d632 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:47.136273 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e5af9-b0dd-4032-99ab-a9ecf964d632 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:47.136367 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e5af9-b0dd-4032-99ab-a9ecf964d632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:47.159077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-591e5af9-b0dd-4032-99ab-a9ecf964d632 None None] MFA Rules not processed for user `5fb45f9358b64974a39d996e93e5c105`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:47.160404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-591e5af9-b0dd-4032-99ab-a9ecf964d632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:47.169524 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 504/976] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Sep 3 21:25:47 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:51.079076 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6a42d-32d6-4396-94d3-adc7f9538fdb None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:51.081049 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6a42d-32d6-4396-94d3-adc7f9538fdb None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:51.081609 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6a42d-32d6-4396-94d3-adc7f9538fdb None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:51.084199 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 473/977] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:25:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:51.091068 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbbdbe-894d-4176-a635-9762d60d52b2 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:51.092054 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbbdbe-894d-4176-a635-9762d60d52b2 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:51.092499 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbbdbe-894d-4176-a635-9762d60d52b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:51.117694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-c7dbbdbe-894d-4176-a635-9762d60d52b2 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:51.119790 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-c7dbbdbe-894d-4176-a635-9762d60d52b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:51.133206 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 505/978] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:25:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 21:25:51.510929 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45852ceb-fe9d-47b7-80de-65c0e1ac409d None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:51.511787 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45852ceb-fe9d-47b7-80de-65c0e1ac409d None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:51.512600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45852ceb-fe9d-47b7-80de-65c0e1ac409d None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:51.515296 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 474/979] 10.222.0.43 () {54 vars in 962 bytes} [Sat Sep 3 21:25:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:51.528517 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a90a9-dec2-40a9-8cbb-c15b0c3b9b9e None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:51.528816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a90a9-dec2-40a9-8cbb-c15b0c3b9b9e None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:51.529020 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a90a9-dec2-40a9-8cbb-c15b0c3b9b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:51.618393 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-ec1a90a9-dec2-40a9-8cbb-c15b0c3b9b9e None None] MFA Rules not processed for user `7d95ba5e28764ed49d1142fecb16adab`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:51.620557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-ec1a90a9-dec2-40a9-8cbb-c15b0c3b9b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:51.721842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 506/980] 10.222.0.43 () {58 vars in 1059 bytes} [Sat Sep 3 21:25:51 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 21:25:51.731086 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45852ceb-fe9d-47b7-80de-65c0e1ac409d None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:25:51.749778 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45852ceb-fe9d-47b7-80de-65c0e1ac409d None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:25:51.755223 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43551aff-9926-46ef-8ba6-421bfdf9681b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:25:51.755906 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43551aff-9926-46ef-8ba6-421bfdf9681b service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:51.756256 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43551aff-9926-46ef-8ba6-421bfdf9681b service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:51.756616 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43551aff-9926-46ef-8ba6-421bfdf9681b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:51.766357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43551aff-9926-46ef-8ba6-421bfdf9681b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:25:51.768217 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43551aff-9926-46ef-8ba6-421bfdf9681b service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:25:51.779487 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 475/981] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:25:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:25:54.252687 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9a98-d262-46e7-8da1-0a7696def4a4 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:54.253215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9a98-d262-46e7-8da1-0a7696def4a4 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:54.253215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e9a98-d262-46e7-8da1-0a7696def4a4 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:54.254741 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 507/982] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:54.260926 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bf215-6876-4de0-a673-73f820b7f24e None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:54.261437 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bf215-6876-4de0-a673-73f820b7f24e None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:54.261521 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bf215-6876-4de0-a673-73f820b7f24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:54.282657 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-d66bf215-6876-4de0-a673-73f820b7f24e None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:54.284162 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-d66bf215-6876-4de0-a673-73f820b7f24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:54.293415 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 476/983] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:25:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:54.651420 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e9a98-d262-46e7-8da1-0a7696def4a4 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:25:54.666348 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e9a98-d262-46e7-8da1-0a7696def4a4 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:25:54.671454 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae835c5-bc33-4fbc-9ec9-8d083bef3c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:25:54.672080 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae835c5-bc33-4fbc-9ec9-8d083bef3c5a service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:54.672354 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae835c5-bc33-4fbc-9ec9-8d083bef3c5a service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:54.672659 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae835c5-bc33-4fbc-9ec9-8d083bef3c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:54.682057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae835c5-bc33-4fbc-9ec9-8d083bef3c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:25:54.683655 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae835c5-bc33-4fbc-9ec9-8d083bef3c5a service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:25:54.700732 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 508/984] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:25:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:25:57.455067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12e807-e949-459d-9a97-5e6296ad1ac3 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:57.455067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12e807-e949-459d-9a97-5e6296ad1ac3 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:57.455067 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12e807-e949-459d-9a97-5e6296ad1ac3 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:57.456302 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 477/985] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:25:57.461344 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa68a80-e39f-4bbc-b2ba-3c1c8581aced None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:57.461837 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa68a80-e39f-4bbc-b2ba-3c1c8581aced None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:57.462134 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa68a80-e39f-4bbc-b2ba-3c1c8581aced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:57.500785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-4fa68a80-e39f-4bbc-b2ba-3c1c8581aced None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:57.502387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-4fa68a80-e39f-4bbc-b2ba-3c1c8581aced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:57.511655 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 509/986] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:25:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:57.872001 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b836-03d5-4b97-9ff1-8bf32bc48647 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:57.872518 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b836-03d5-4b97-9ff1-8bf32bc48647 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:57.873422 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10b836-03d5-4b97-9ff1-8bf32bc48647 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:57.874649 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 478/987] 10.222.0.43 () {54 vars in 962 bytes} [Sat Sep 3 21:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:25:57.880372 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68f483-db19-4e46-961c-585b73876a22 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:57.885611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68f483-db19-4e46-961c-585b73876a22 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:57.885611 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68f483-db19-4e46-961c-585b73876a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:57.903695 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-6b68f483-db19-4e46-961c-585b73876a22 None None] MFA Rules not processed for user `7d95ba5e28764ed49d1142fecb16adab`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:25:57.905279 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-6b68f483-db19-4e46-961c-585b73876a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:25:57.916869 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 510/988] 10.222.0.43 () {58 vars in 1059 bytes} [Sat Sep 3 21:25:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:25:57.927211 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10b836-03d5-4b97-9ff1-8bf32bc48647 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:25:57.948121 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10b836-03d5-4b97-9ff1-8bf32bc48647 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:25:57.954180 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2a5a3-c3ae-468a-8196-903f71e4c37f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:25:57.955370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2a5a3-c3ae-468a-8196-903f71e4c37f service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:25:57.955844 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2a5a3-c3ae-468a-8196-903f71e4c37f service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:25:57.956111 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2a5a3-c3ae-468a-8196-903f71e4c37f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:25:57.966327 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2a5a3-c3ae-468a-8196-903f71e4c37f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:25:57.967949 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2a5a3-c3ae-468a-8196-903f71e4c37f service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:25:57.981531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 479/989] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:25:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 21:26:00.545630 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191b8e4-1016-488a-808b-e783d23a3812 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:00.546683 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191b8e4-1016-488a-808b-e783d23a3812 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:00.547224 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191b8e4-1016-488a-808b-e783d23a3812 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:00.554126 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cd0de-ec3b-4519-89d2-8f31a2c2dec0 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:00.555045 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cd0de-ec3b-4519-89d2-8f31a2c2dec0 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:00.556072 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cd0de-ec3b-4519-89d2-8f31a2c2dec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:00.559274 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 511/990] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:26:00 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:00.578373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-759cd0de-ec3b-4519-89d2-8f31a2c2dec0 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:00.579930 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-759cd0de-ec3b-4519-89d2-8f31a2c2dec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:00.597022 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 480/991] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:26:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 21:26:00.949071 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191b8e4-1016-488a-808b-e783d23a3812 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:00.964886 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191b8e4-1016-488a-808b-e783d23a3812 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:00.970632 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e4270-59ec-487c-93e4-48c88136f6b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:00.971573 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e4270-59ec-487c-93e4-48c88136f6b4 service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:00.972010 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e4270-59ec-487c-93e4-48c88136f6b4 service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:00.972496 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e4270-59ec-487c-93e4-48c88136f6b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:00.983419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e4270-59ec-487c-93e4-48c88136f6b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:00.985435 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e4270-59ec-487c-93e4-48c88136f6b4 service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:01.008418 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 512/992] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:01.769514 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a63b6-2c02-476d-bd2c-fd092c39175f None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:01.769514 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a63b6-2c02-476d-bd2c-fd092c39175f None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:01.769514 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a63b6-2c02-476d-bd2c-fd092c39175f None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:01.777085 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 481/993] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:26:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:01.777645 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14009e-f460-4fae-8cdf-b61f25b0d9d7 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:01.777645 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14009e-f460-4fae-8cdf-b61f25b0d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:01.777645 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14009e-f460-4fae-8cdf-b61f25b0d9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:01.835199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-3d14009e-f460-4fae-8cdf-b61f25b0d9d7 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:01.840514 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-3d14009e-f460-4fae-8cdf-b61f25b0d9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:01.864986 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 513/994] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:26:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:02.476402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b51eb-a817-48d0-84af-04a7cdedb094 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:02.476402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b51eb-a817-48d0-84af-04a7cdedb094 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:02.476402 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b51eb-a817-48d0-84af-04a7cdedb094 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:02.479562 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 482/995] 10.222.0.43 () {54 vars in 964 bytes} [Sat Sep 3 21:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:02.489515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9ed8d-80d8-424d-bced-8f8f4b3e7f60 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:02.490046 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9ed8d-80d8-424d-bced-8f8f4b3e7f60 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:02.490315 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9ed8d-80d8-424d-bced-8f8f4b3e7f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:02.547605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-4ed9ed8d-80d8-424d-bced-8f8f4b3e7f60 None None] MFA Rules not processed for user `90cd1e165f3c4eba95dc93a25011b695`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:02.548835 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-4ed9ed8d-80d8-424d-bced-8f8f4b3e7f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:02.583754 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:26:02.615470 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 514/996] 10.222.0.43 () {58 vars in 1061 bytes} [Sat Sep 3 21:26:02 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:02.623643 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b51eb-a817-48d0-84af-04a7cdedb094 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:02.635596 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b51eb-a817-48d0-84af-04a7cdedb094 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:02.639615 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65df86-1260-4dc5-9cd2-5c798474b630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90cd1e165f3c4eba95dc93a25011b695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:02.641461 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65df86-1260-4dc5-9cd2-5c798474b630 service cinder] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:02.641461 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65df86-1260-4dc5-9cd2-5c798474b630 service cinder] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:02.641461 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65df86-1260-4dc5-9cd2-5c798474b630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:02.651731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65df86-1260-4dc5-9cd2-5c798474b630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:02.653611 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65df86-1260-4dc5-9cd2-5c798474b630 service cinder] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:02.670360 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 483/997] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:03.619718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df95d6-e0f5-4e23-bb62-e226cd8487bf None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:03.620431 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df95d6-e0f5-4e23-bb62-e226cd8487bf None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:03.620431 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df95d6-e0f5-4e23-bb62-e226cd8487bf None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:03.624129 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 515/998] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:26:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:03.627329 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cbd0b-b059-43f8-b6f5-d3ae398a0945 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:03.628073 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cbd0b-b059-43f8-b6f5-d3ae398a0945 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:03.628444 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cbd0b-b059-43f8-b6f5-d3ae398a0945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:03.652632 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-5a2cbd0b-b059-43f8-b6f5-d3ae398a0945 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:03.653866 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-5a2cbd0b-b059-43f8-b6f5-d3ae398a0945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:03.662121 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 484/999] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:26:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:04.023356 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df95d6-e0f5-4e23-bb62-e226cd8487bf None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:04.038536 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df95d6-e0f5-4e23-bb62-e226cd8487bf None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:04.044477 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16fecb-cb63-4244-a6d1-ac09d5174584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:04.045192 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16fecb-cb63-4244-a6d1-ac09d5174584 service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:04.045557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16fecb-cb63-4244-a6d1-ac09d5174584 service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:04.045961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16fecb-cb63-4244-a6d1-ac09d5174584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:04.054898 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16fecb-cb63-4244-a6d1-ac09d5174584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:04.056564 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16fecb-cb63-4244-a6d1-ac09d5174584 service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:04.066739 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 516/1000] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:06.536694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aa9db-acc6-4c1d-a34d-9240f98eeee2 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:06.537526 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aa9db-acc6-4c1d-a34d-9240f98eeee2 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:06.537951 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aa9db-acc6-4c1d-a34d-9240f98eeee2 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:06.539781 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 485/1001] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:06.545376 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8951-1b51-4d9f-81bd-f8137f02b116 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:06.545821 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8951-1b51-4d9f-81bd-f8137f02b116 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:06.545924 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd8951-1b51-4d9f-81bd-f8137f02b116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:06.566782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-99bd8951-1b51-4d9f-81bd-f8137f02b116 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:06.568004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-99bd8951-1b51-4d9f-81bd-f8137f02b116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:06.577104 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 517/1002] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:26:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:06.957201 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611aa9db-acc6-4c1d-a34d-9240f98eeee2 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:06.971638 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611aa9db-acc6-4c1d-a34d-9240f98eeee2 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:06.977643 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a124a34-7cdb-4d21-be36-88da835f5601 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:06.978700 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124a34-7cdb-4d21-be36-88da835f5601 service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:06.979153 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124a34-7cdb-4d21-be36-88da835f5601 service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:06.979576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a124a34-7cdb-4d21-be36-88da835f5601 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:06.988956 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a124a34-7cdb-4d21-be36-88da835f5601 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:06.990797 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a124a34-7cdb-4d21-be36-88da835f5601 service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:07.002843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 486/1003] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:09.428830 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253cdbf-8858-4729-afa0-81f4012ebdeb None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:09.429373 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253cdbf-8858-4729-afa0-81f4012ebdeb None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:09.429373 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253cdbf-8858-4729-afa0-81f4012ebdeb None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:09.432941 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 518/1004] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:26:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:09.437834 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6032e4-2e68-4752-b9a3-a499b96011bf None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:09.438353 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6032e4-2e68-4752-b9a3-a499b96011bf None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:09.438353 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6032e4-2e68-4752-b9a3-a499b96011bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:09.460368 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-de6032e4-2e68-4752-b9a3-a499b96011bf None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:09.462505 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-de6032e4-2e68-4752-b9a3-a499b96011bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:09.471259 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 487/1005] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:26:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:09.834745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253cdbf-8858-4729-afa0-81f4012ebdeb None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:09.849313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253cdbf-8858-4729-afa0-81f4012ebdeb None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:09.855503 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883a923-1a34-4640-bda6-9c189391e8a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:09.856105 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883a923-1a34-4640-bda6-9c189391e8a8 service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:09.856384 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883a923-1a34-4640-bda6-9c189391e8a8 service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:09.856718 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883a923-1a34-4640-bda6-9c189391e8a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:09.866029 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883a923-1a34-4640-bda6-9c189391e8a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:09.868390 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883a923-1a34-4640-bda6-9c189391e8a8 service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:09.879545 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 519/1006] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:12.405132 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3d7d-06b1-4990-a227-e9c1e6026fdd None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:12.417493 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3d7d-06b1-4990-a227-e9c1e6026fdd None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:12.417493 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3d7d-06b1-4990-a227-e9c1e6026fdd None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:12.417493 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 488/1007] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:26:12.420592 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc0972-8e76-4937-9ccd-1f1892cb0bb3 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:12.421124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc0972-8e76-4937-9ccd-1f1892cb0bb3 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:12.421225 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc0972-8e76-4937-9ccd-1f1892cb0bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:12.457574 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-87cc0972-8e76-4937-9ccd-1f1892cb0bb3 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:12.460673 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-87cc0972-8e76-4937-9ccd-1f1892cb0bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:12.470628 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 520/1008] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:26:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 21:26:12.948311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac3d7d-06b1-4990-a227-e9c1e6026fdd None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:12.960492 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac3d7d-06b1-4990-a227-e9c1e6026fdd None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:12.966325 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d32b9-63b4-46db-85ce-1ed0574c3bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:12.966918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d32b9-63b4-46db-85ce-1ed0574c3bd1 service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:12.967276 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d32b9-63b4-46db-85ce-1ed0574c3bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:12.967548 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d32b9-63b4-46db-85ce-1ed0574c3bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:12.977337 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d32b9-63b4-46db-85ce-1ed0574c3bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:12.978940 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d32b9-63b4-46db-85ce-1ed0574c3bd1 service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:12.989262 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 489/1009] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:16.765283 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56640b1-9783-4b6e-9705-df84b0ad34d3 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:16.766034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56640b1-9783-4b6e-9705-df84b0ad34d3 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:16.766034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56640b1-9783-4b6e-9705-df84b0ad34d3 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:16.768176 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 521/1010] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:26:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:16.776141 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c769abb-9fbf-4684-9709-0d43561a488c None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:16.776756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c769abb-9fbf-4684-9709-0d43561a488c None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:16.776866 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c769abb-9fbf-4684-9709-0d43561a488c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:16.784774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=43 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:26:16.800327 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-0c769abb-9fbf-4684-9709-0d43561a488c None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:16.801614 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-0c769abb-9fbf-4684-9709-0d43561a488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:16.809661 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 490/1011] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:26:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:17.172478 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56640b1-9783-4b6e-9705-df84b0ad34d3 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:17.187401 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56640b1-9783-4b6e-9705-df84b0ad34d3 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:17.192606 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a7eb6-cacb-4ba5-94a3-0173fe562c96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:17.193220 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a7eb6-cacb-4ba5-94a3-0173fe562c96 service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:17.193499 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a7eb6-cacb-4ba5-94a3-0173fe562c96 service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:17.193830 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a7eb6-cacb-4ba5-94a3-0173fe562c96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:17.203491 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a7eb6-cacb-4ba5-94a3-0173fe562c96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:17.205220 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a7eb6-cacb-4ba5-94a3-0173fe562c96 service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:17.216209 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 522/1012] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:19.295922 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1f4cf-3c18-4b7c-baf2-0428c3f24cb8 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:19.296613 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1f4cf-3c18-4b7c-baf2-0428c3f24cb8 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:19.296613 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1f4cf-3c18-4b7c-baf2-0428c3f24cb8 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:19.297838 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 491/1013] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:19.303353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1d7a-9356-45ad-83de-077e4533ffb2 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:19.303867 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1d7a-9356-45ad-83de-077e4533ffb2 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:19.303867 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d1d7a-9356-45ad-83de-077e4533ffb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:19.323846 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-7c1d1d7a-9356-45ad-83de-077e4533ffb2 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:19.325097 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-7c1d1d7a-9356-45ad-83de-077e4533ffb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:19.333177 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 523/1014] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:26:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:19.627228 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef27d-19a2-491b-84d6-ea32e2016b91 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:19.627468 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef27d-19a2-491b-84d6-ea32e2016b91 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:19.627760 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef27d-19a2-491b-84d6-ea32e2016b91 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:19.631485 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 492/1015] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:19.635467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5428d00-204f-465c-801c-48a90d2a69ac None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:19.635758 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5428d00-204f-465c-801c-48a90d2a69ac None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:19.636064 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5428d00-204f-465c-801c-48a90d2a69ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:19.657591 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-f5428d00-204f-465c-801c-48a90d2a69ac None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:19.658636 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-f5428d00-204f-465c-801c-48a90d2a69ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:19.667508 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 524/1016] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:26:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:19.701895 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace2d5b-5dd7-470f-ab0a-b4be36b01675 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:19.702257 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace2d5b-5dd7-470f-ab0a-b4be36b01675 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:19.702596 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace2d5b-5dd7-470f-ab0a-b4be36b01675 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:19.704052 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 493/1017] 10.222.0.43 () {54 vars in 961 bytes} [Sat Sep 3 21:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:19.709322 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba517aad-42cd-4621-b3ab-84e4549d420e None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:19.709601 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba517aad-42cd-4621-b3ab-84e4549d420e None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:19.709869 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba517aad-42cd-4621-b3ab-84e4549d420e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:19.776392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-ba517aad-42cd-4621-b3ab-84e4549d420e None None] MFA Rules not processed for user `c05e9121d1bc48d497410de13a07b198`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:19.778501 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-ba517aad-42cd-4621-b3ab-84e4549d420e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:19.853186 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 525/1018] 10.222.0.43 () {58 vars in 1058 bytes} [Sat Sep 3 21:26:19 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:19.861061 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace2d5b-5dd7-470f-ab0a-b4be36b01675 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:19.872612 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace2d5b-5dd7-470f-ab0a-b4be36b01675 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:19.876246 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60357a48-39b9-47d7-96a2-2477d3b146d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05e9121d1bc48d497410de13a07b198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:19.876905 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60357a48-39b9-47d7-96a2-2477d3b146d0 service glance] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:19.877433 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60357a48-39b9-47d7-96a2-2477d3b146d0 service glance] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:19.877651 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60357a48-39b9-47d7-96a2-2477d3b146d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:19.888902 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60357a48-39b9-47d7-96a2-2477d3b146d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:19.890396 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60357a48-39b9-47d7-96a2-2477d3b146d0 service glance] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:19.903247 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 494/1019] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:20.022319 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba517aad-42cd-4621-b3ab-84e4549d420e None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:20.035060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba517aad-42cd-4621-b3ab-84e4549d420e None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:20.040301 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3c28a-c3fe-4f99-915a-72380f912d1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:20.040973 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3c28a-c3fe-4f99-915a-72380f912d1c service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:20.041252 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3c28a-c3fe-4f99-915a-72380f912d1c service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:20.041524 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3c28a-c3fe-4f99-915a-72380f912d1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:20.050338 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3c28a-c3fe-4f99-915a-72380f912d1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:20.052056 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3c28a-c3fe-4f99-915a-72380f912d1c service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:20.062991 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 526/1020] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 21:26:22.543264 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4c750-f111-435b-8e56-8b16ee47fe8a None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:22.543264 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4c750-f111-435b-8e56-8b16ee47fe8a None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:22.543264 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4c750-f111-435b-8e56-8b16ee47fe8a None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:22.545946 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 495/1021] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:22.552415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f18d95-8788-4130-8fb4-631140cdf334 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:22.553040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f18d95-8788-4130-8fb4-631140cdf334 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:22.553040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f18d95-8788-4130-8fb4-631140cdf334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:22.577255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-c3f18d95-8788-4130-8fb4-631140cdf334 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:22.578765 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-c3f18d95-8788-4130-8fb4-631140cdf334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:22.588815 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 527/1022] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:26:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:22.950823 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4c750-f111-435b-8e56-8b16ee47fe8a None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:22.966613 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4c750-f111-435b-8e56-8b16ee47fe8a None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:22.974565 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e28b96-abe7-4ffc-b00e-1d1be2db672d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:22.975225 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e28b96-abe7-4ffc-b00e-1d1be2db672d service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:22.975504 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e28b96-abe7-4ffc-b00e-1d1be2db672d service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:22.975783 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e28b96-abe7-4ffc-b00e-1d1be2db672d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:22.986359 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e28b96-abe7-4ffc-b00e-1d1be2db672d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:22.988010 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e28b96-abe7-4ffc-b00e-1d1be2db672d service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:22.999477 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 496/1023] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:25.895486 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df2dd4-40d1-40a5-8e0e-149d8e051a3d None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:25.896126 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df2dd4-40d1-40a5-8e0e-149d8e051a3d None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:25.896126 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df2dd4-40d1-40a5-8e0e-149d8e051a3d None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:25.897438 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 528/1024] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:26:25.908427 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d135cd1-ff8c-4e0a-89fe-94a508c20694 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:25.908947 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d135cd1-ff8c-4e0a-89fe-94a508c20694 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:25.909397 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d135cd1-ff8c-4e0a-89fe-94a508c20694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:25.936013 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-9d135cd1-ff8c-4e0a-89fe-94a508c20694 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:25.937607 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-9d135cd1-ff8c-4e0a-89fe-94a508c20694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:25.949377 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 497/1025] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:26:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:26.309602 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df2dd4-40d1-40a5-8e0e-149d8e051a3d None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:26.324181 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df2dd4-40d1-40a5-8e0e-149d8e051a3d None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:26.331433 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc2837-bdb4-4b87-a63c-8fc5b0fba702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:26.332055 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2837-bdb4-4b87-a63c-8fc5b0fba702 service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:26.332337 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2837-bdb4-4b87-a63c-8fc5b0fba702 service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:26.332649 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2837-bdb4-4b87-a63c-8fc5b0fba702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:26.342000 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc2837-bdb4-4b87-a63c-8fc5b0fba702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:26.344239 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc2837-bdb4-4b87-a63c-8fc5b0fba702 service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:26.355499 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 529/1026] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:35.928552 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=17 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:26:36.161063 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8704c9-8720-49eb-a589-706c004c39f8 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:36.161257 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8704c9-8720-49eb-a589-706c004c39f8 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:36.161530 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8704c9-8720-49eb-a589-706c004c39f8 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:36.162918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 498/1027] 10.222.0.43 () {54 vars in 918 bytes} [Sat Sep 3 21:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:36.168376 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965458f9-e489-4425-b0d8-72aa8e38e558 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:36.168935 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965458f9-e489-4425-b0d8-72aa8e38e558 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:36.168935 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965458f9-e489-4425-b0d8-72aa8e38e558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:36.176495 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=95 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:26:36.188473 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-965458f9-e489-4425-b0d8-72aa8e38e558 None None] MFA Rules not processed for user `5fb45f9358b64974a39d996e93e5c105`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:36.192045 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-965458f9-e489-4425-b0d8-72aa8e38e558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:36.198827 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 530/1028] 10.222.0.43 () {58 vars in 1015 bytes} [Sat Sep 3 21:26:36 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:36.213776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7a22b-e973-4131-86da-eef2f4683f7b None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:36.214064 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7a22b-e973-4131-86da-eef2f4683f7b None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:36.214344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7a22b-e973-4131-86da-eef2f4683f7b None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:36.215682 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 499/1029] 10.222.0.43 () {54 vars in 918 bytes} [Sat Sep 3 21:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:36.220215 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689b3a4-4a14-475e-bbe5-91ca58af26b5 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:36.220498 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689b3a4-4a14-475e-bbe5-91ca58af26b5 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:36.220806 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689b3a4-4a14-475e-bbe5-91ca58af26b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:36.240240 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-c689b3a4-4a14-475e-bbe5-91ca58af26b5 None None] MFA Rules not processed for user `7d95ba5e28764ed49d1142fecb16adab`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:36.242049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-c689b3a4-4a14-475e-bbe5-91ca58af26b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:36.250199 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 531/1030] 10.222.0.43 () {58 vars in 1015 bytes} [Sat Sep 3 21:26:36 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:38.960101 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba85c-75f3-4d28-8095-79beef4305d5 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:38.960754 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba85c-75f3-4d28-8095-79beef4305d5 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:38.960754 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba85c-75f3-4d28-8095-79beef4305d5 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:38.962121 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 500/1031] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:38.967467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1653dae-cf60-4f7f-b2fd-1052f6cb7b3b None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:38.967910 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1653dae-cf60-4f7f-b2fd-1052f6cb7b3b None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:38.968027 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1653dae-cf60-4f7f-b2fd-1052f6cb7b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:38.986991 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-a1653dae-cf60-4f7f-b2fd-1052f6cb7b3b None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:38.988195 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-a1653dae-cf60-4f7f-b2fd-1052f6cb7b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:38.996962 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 532/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:26:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:39.360846 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ba85c-75f3-4d28-8095-79beef4305d5 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:39.374820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ba85c-75f3-4d28-8095-79beef4305d5 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:39.379751 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0775573-f296-4321-95d2-e46e791f7ec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:39.380343 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0775573-f296-4321-95d2-e46e791f7ec3 service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:39.380660 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0775573-f296-4321-95d2-e46e791f7ec3 service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:39.380937 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0775573-f296-4321-95d2-e46e791f7ec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:39.389405 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0775573-f296-4321-95d2-e46e791f7ec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:39.391008 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0775573-f296-4321-95d2-e46e791f7ec3 service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:39.401373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 501/1033] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:40.377919 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3b4f-408c-4226-99fa-49b4a681d9e6 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:40.378459 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3b4f-408c-4226-99fa-49b4a681d9e6 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:40.378459 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3b4f-408c-4226-99fa-49b4a681d9e6 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:40.379729 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 533/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 21:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:40.385531 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b210256-1d40-4831-ad86-c0a18de7587b None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:40.386007 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b210256-1d40-4831-ad86-c0a18de7587b None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:40.386104 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b210256-1d40-4831-ad86-c0a18de7587b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:40.405637 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-0b210256-1d40-4831-ad86-c0a18de7587b None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:40.406834 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-0b210256-1d40-4831-ad86-c0a18de7587b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:40.414703 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 502/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 21:26:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:40.650318 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3b4f-408c-4226-99fa-49b4a681d9e6 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:40.664426 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3b4f-408c-4226-99fa-49b4a681d9e6 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:40.669425 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffbb4c6-b081-4204-872a-8dac1f54ae94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:40.670057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbb4c6-b081-4204-872a-8dac1f54ae94 service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:40.670336 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbb4c6-b081-4204-872a-8dac1f54ae94 service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:40.670606 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffbb4c6-b081-4204-872a-8dac1f54ae94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:40.679019 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbb4c6-b081-4204-872a-8dac1f54ae94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:40.681443 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffbb4c6-b081-4204-872a-8dac1f54ae94 service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:40.691342 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 534/1036] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:41.612653 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529208e-32f9-4f65-a1da-a7090b63d4d7 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:41.613236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529208e-32f9-4f65-a1da-a7090b63d4d7 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:41.613236 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529208e-32f9-4f65-a1da-a7090b63d4d7 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:41.614509 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 503/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 21:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:26:41.619620 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3823-47b0-41f5-bb7e-4a36d289f6bd None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:41.620040 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3823-47b0-41f5-bb7e-4a36d289f6bd None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:41.620151 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3823-47b0-41f5-bb7e-4a36d289f6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:41.639889 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-80bd3823-47b0-41f5-bb7e-4a36d289f6bd None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:41.641525 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-80bd3823-47b0-41f5-bb7e-4a36d289f6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:41.650062 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 535/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 21:26:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:41.811743 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529208e-32f9-4f65-a1da-a7090b63d4d7 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:41.826526 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529208e-32f9-4f65-a1da-a7090b63d4d7 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:41.831591 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1be86b-e17e-4f09-8ce8-345beda53387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:41.832195 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1be86b-e17e-4f09-8ce8-345beda53387 service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:41.832475 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1be86b-e17e-4f09-8ce8-345beda53387 service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:41.832782 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1be86b-e17e-4f09-8ce8-345beda53387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:41.841430 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1be86b-e17e-4f09-8ce8-345beda53387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:41.843185 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1be86b-e17e-4f09-8ce8-345beda53387 service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:41.853381 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 504/1039] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:42.754256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5f80d-0f88-42b6-aa21-b48989e3b1fb None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:42.754831 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5f80d-0f88-42b6-aa21-b48989e3b1fb None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:42.754831 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5f80d-0f88-42b6-aa21-b48989e3b1fb None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:42.756342 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 536/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 21:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:42.761963 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47498f3f-e5ad-4113-9d51-68a54bf0f293 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:42.762487 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47498f3f-e5ad-4113-9d51-68a54bf0f293 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:42.762595 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47498f3f-e5ad-4113-9d51-68a54bf0f293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:42.782846 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-47498f3f-e5ad-4113-9d51-68a54bf0f293 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:42.784038 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-47498f3f-e5ad-4113-9d51-68a54bf0f293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:42.792422 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 505/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 21:26:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:42.949515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5f80d-0f88-42b6-aa21-b48989e3b1fb None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:42.964059 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5f80d-0f88-42b6-aa21-b48989e3b1fb None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:42.969099 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c5159-00f1-4b95-87ab-1e54dd91f322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:42.969707 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c5159-00f1-4b95-87ab-1e54dd91f322 service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:42.969982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c5159-00f1-4b95-87ab-1e54dd91f322 service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:42.970256 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c5159-00f1-4b95-87ab-1e54dd91f322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:42.979376 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c5159-00f1-4b95-87ab-1e54dd91f322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:42.981018 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c5159-00f1-4b95-87ab-1e54dd91f322 service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:42.990712 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 537/1042] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:43.878376 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc34c7b-c3bc-4bc1-a28c-f332e084e0cb None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:43.878961 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc34c7b-c3bc-4bc1-a28c-f332e084e0cb None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:43.878961 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc34c7b-c3bc-4bc1-a28c-f332e084e0cb None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:43.880269 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 506/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 21:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:43.886210 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbb20e-cf81-48fb-87e9-9104247c502a None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:43.886664 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbb20e-cf81-48fb-87e9-9104247c502a None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:43.886819 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbb20e-cf81-48fb-87e9-9104247c502a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:43.907986 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-84fbb20e-cf81-48fb-87e9-9104247c502a None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:43.909237 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-84fbb20e-cf81-48fb-87e9-9104247c502a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:43.917534 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 538/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 21:26:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 21:26:44.076680 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc34c7b-c3bc-4bc1-a28c-f332e084e0cb None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:44.091292 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc34c7b-c3bc-4bc1-a28c-f332e084e0cb None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:44.096541 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677da698-0972-4646-ba5a-b40ef120278a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:44.097208 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677da698-0972-4646-ba5a-b40ef120278a service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:44.097485 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677da698-0972-4646-ba5a-b40ef120278a service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:44.097758 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677da698-0972-4646-ba5a-b40ef120278a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:44.109690 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677da698-0972-4646-ba5a-b40ef120278a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:44.111320 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677da698-0972-4646-ba5a-b40ef120278a service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:44.122335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 507/1045] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:45.022381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ba9b4-19fd-4241-bcbd-ebda4818093e None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:45.023659 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ba9b4-19fd-4241-bcbd-ebda4818093e None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:45.023659 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ba9b4-19fd-4241-bcbd-ebda4818093e None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:45.024895 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 539/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 21:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:45.030114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fce11-db48-4589-912b-4f02f25fbd1a None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:45.030572 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fce11-db48-4589-912b-4f02f25fbd1a None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:45.030765 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fce11-db48-4589-912b-4f02f25fbd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:45.051356 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-895fce11-db48-4589-912b-4f02f25fbd1a None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:45.052563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-895fce11-db48-4589-912b-4f02f25fbd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:45.060370 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 508/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 21:26:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:45.222493 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ba9b4-19fd-4241-bcbd-ebda4818093e None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:45.237927 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ba9b4-19fd-4241-bcbd-ebda4818093e None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:45.243201 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db9311-09df-48c3-8fa5-1f4c998b5cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:45.243812 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db9311-09df-48c3-8fa5-1f4c998b5cd3 service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:45.244090 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db9311-09df-48c3-8fa5-1f4c998b5cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:45.244363 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db9311-09df-48c3-8fa5-1f4c998b5cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:45.252985 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db9311-09df-48c3-8fa5-1f4c998b5cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:45.254568 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db9311-09df-48c3-8fa5-1f4c998b5cd3 service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:45.264945 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 540/1048] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:46.152094 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b025-2a13-4ea7-8382-ccfc19e54af9 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:46.152654 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b025-2a13-4ea7-8382-ccfc19e54af9 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:46.152768 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b025-2a13-4ea7-8382-ccfc19e54af9 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:46.154052 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 509/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 21:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:46.159080 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99b9a-a049-4921-93e0-79591a8e31ee None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:46.159516 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99b9a-a049-4921-93e0-79591a8e31ee None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:46.159740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99b9a-a049-4921-93e0-79591a8e31ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:46.181226 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-c7a99b9a-a049-4921-93e0-79591a8e31ee None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:46.182332 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-c7a99b9a-a049-4921-93e0-79591a8e31ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:46.190141 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 541/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 21:26:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:46.351641 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6b025-2a13-4ea7-8382-ccfc19e54af9 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:46.365109 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6b025-2a13-4ea7-8382-ccfc19e54af9 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:46.369944 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca23444-4261-4916-956e-655bc6357804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:46.370530 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca23444-4261-4916-956e-655bc6357804 service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:46.370804 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca23444-4261-4916-956e-655bc6357804 service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:46.371095 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca23444-4261-4916-956e-655bc6357804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:46.379385 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca23444-4261-4916-956e-655bc6357804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:46.381048 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca23444-4261-4916-956e-655bc6357804 service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:46.391207 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 510/1051] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:47.249367 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b5306-599f-411a-9db5-dbe5aed65a72 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:47.249909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b5306-599f-411a-9db5-dbe5aed65a72 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:47.249909 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b5306-599f-411a-9db5-dbe5aed65a72 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:47.251350 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 542/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 21:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:47.256374 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874687f8-0e6d-4662-acdb-e1b9c4c30e5c None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:47.256901 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874687f8-0e6d-4662-acdb-e1b9c4c30e5c None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:47.257190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874687f8-0e6d-4662-acdb-e1b9c4c30e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:47.278872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-874687f8-0e6d-4662-acdb-e1b9c4c30e5c None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:47.278872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-874687f8-0e6d-4662-acdb-e1b9c4c30e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:47.286739 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 511/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 21:26:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:47.445094 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b5306-599f-411a-9db5-dbe5aed65a72 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:47.458714 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b5306-599f-411a-9db5-dbe5aed65a72 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:47.464388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28bd4d-f6a1-4079-ae85-1a5a92de3da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:47.465013 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28bd4d-f6a1-4079-ae85-1a5a92de3da4 service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:47.465292 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28bd4d-f6a1-4079-ae85-1a5a92de3da4 service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:47.465560 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28bd4d-f6a1-4079-ae85-1a5a92de3da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:47.473982 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28bd4d-f6a1-4079-ae85-1a5a92de3da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:47.475553 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28bd4d-f6a1-4079-ae85-1a5a92de3da4 service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:47.485152 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 543/1054] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:48.368186 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba04d80-ddd9-469e-81a2-4bde863d1321 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:48.368805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba04d80-ddd9-469e-81a2-4bde863d1321 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:48.368805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba04d80-ddd9-469e-81a2-4bde863d1321 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:48.370017 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 512/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 21:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:48.374945 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f91689-e88f-4486-93ba-2981318e12fa None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:48.375407 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f91689-e88f-4486-93ba-2981318e12fa None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:48.375500 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f91689-e88f-4486-93ba-2981318e12fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:48.395553 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-c1f91689-e88f-4486-93ba-2981318e12fa None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:48.396795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-c1f91689-e88f-4486-93ba-2981318e12fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:48.405337 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 544/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 21:26:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:48.563660 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba04d80-ddd9-469e-81a2-4bde863d1321 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:48.578605 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba04d80-ddd9-469e-81a2-4bde863d1321 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:48.583610 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f74404-4919-40e3-934b-471d44e4103b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:48.584203 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74404-4919-40e3-934b-471d44e4103b service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:48.584481 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74404-4919-40e3-934b-471d44e4103b service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:48.584784 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f74404-4919-40e3-934b-471d44e4103b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:48.593423 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f74404-4919-40e3-934b-471d44e4103b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:48.595005 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f74404-4919-40e3-934b-471d44e4103b service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:48.604695 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 513/1057] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:50.728340 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d249c65-5bab-492f-98ff-0ed308ec7b9b None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:50.728906 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d249c65-5bab-492f-98ff-0ed308ec7b9b None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:50.729164 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d249c65-5bab-492f-98ff-0ed308ec7b9b None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:50.730795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 545/1058] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:26:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:50.736684 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4572e-8ec5-4f3c-8b8a-7356db231047 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:50.737175 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4572e-8ec5-4f3c-8b8a-7356db231047 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:50.737271 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4572e-8ec5-4f3c-8b8a-7356db231047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:50.756731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-f7e4572e-8ec5-4f3c-8b8a-7356db231047 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:50.757998 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-f7e4572e-8ec5-4f3c-8b8a-7356db231047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:50.766524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 514/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:26:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:51.109869 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d249c65-5bab-492f-98ff-0ed308ec7b9b None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:51.121201 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d249c65-5bab-492f-98ff-0ed308ec7b9b None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:51.124659 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d2e79-5f2c-412f-a650-cf377d3fb33b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:51.125314 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d2e79-5f2c-412f-a650-cf377d3fb33b service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:51.125580 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d2e79-5f2c-412f-a650-cf377d3fb33b service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:51.125844 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d2e79-5f2c-412f-a650-cf377d3fb33b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:51.136077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d2e79-5f2c-412f-a650-cf377d3fb33b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:51.137645 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d2e79-5f2c-412f-a650-cf377d3fb33b service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:51.148976 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 546/1060] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:53.593280 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111ad23-11f0-4b45-b5c3-4534451677a6 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:53.593821 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111ad23-11f0-4b45-b5c3-4534451677a6 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:53.593821 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111ad23-11f0-4b45-b5c3-4534451677a6 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:53.595152 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 515/1061] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:53.600959 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6d493-267f-4550-b2af-70b3c7a1ca8c None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:53.601498 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6d493-267f-4550-b2af-70b3c7a1ca8c None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:53.601767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6d493-267f-4550-b2af-70b3c7a1ca8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:53.621666 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-84c6d493-267f-4550-b2af-70b3c7a1ca8c None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:53.622872 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-84c6d493-267f-4550-b2af-70b3c7a1ca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:53.630666 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 547/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:26:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:53.972663 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111ad23-11f0-4b45-b5c3-4534451677a6 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:53.984946 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111ad23-11f0-4b45-b5c3-4534451677a6 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:53.988625 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe807ad3-2a0c-4826-8c9c-827900dbe853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:53.989232 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe807ad3-2a0c-4826-8c9c-827900dbe853 service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:53.989510 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe807ad3-2a0c-4826-8c9c-827900dbe853 service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:53.989780 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe807ad3-2a0c-4826-8c9c-827900dbe853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:53.999517 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe807ad3-2a0c-4826-8c9c-827900dbe853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:54.000992 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe807ad3-2a0c-4826-8c9c-827900dbe853 service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:54.010607 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 516/1063] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:56.737367 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6561-2d27-482e-a308-ab8242665787 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:56.737902 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6561-2d27-482e-a308-ab8242665787 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:56.737902 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371c6561-2d27-482e-a308-ab8242665787 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:56.739339 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 548/1064] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:26:56.745134 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3988b-7914-4ff8-be59-dfee462ea92a None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:56.745616 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3988b-7914-4ff8-be59-dfee462ea92a None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:56.745733 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3988b-7914-4ff8-be59-dfee462ea92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:56.766054 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-58e3988b-7914-4ff8-be59-dfee462ea92a None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:56.767189 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-58e3988b-7914-4ff8-be59-dfee462ea92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:56.776100 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 517/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:26:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 21:26:57.121631 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c6561-2d27-482e-a308-ab8242665787 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:57.133665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371c6561-2d27-482e-a308-ab8242665787 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:57.137358 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3488ba-212c-46fe-844c-1d09bbc5eded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:57.137979 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3488ba-212c-46fe-844c-1d09bbc5eded service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:57.138261 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3488ba-212c-46fe-844c-1d09bbc5eded service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:57.138553 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3488ba-212c-46fe-844c-1d09bbc5eded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:57.149625 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3488ba-212c-46fe-844c-1d09bbc5eded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:57.151091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3488ba-212c-46fe-844c-1d09bbc5eded service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:57.161719 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 549/1066] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:26:59.505479 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daab1f-0dc0-4d61-815a-2095312b2eb7 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:59.506062 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daab1f-0dc0-4d61-815a-2095312b2eb7 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:59.506062 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daab1f-0dc0-4d61-815a-2095312b2eb7 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:59.507975 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 518/1067] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:26:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:26:59.514035 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2867f-f723-42f9-9b9d-82340ea69535 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:59.514493 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2867f-f723-42f9-9b9d-82340ea69535 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:59.514586 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2867f-f723-42f9-9b9d-82340ea69535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:59.534266 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-76d2867f-f723-42f9-9b9d-82340ea69535 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:26:59.535450 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-76d2867f-f723-42f9-9b9d-82340ea69535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:26:59.543521 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 550/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:26:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:26:59.890023 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daab1f-0dc0-4d61-815a-2095312b2eb7 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:26:59.901125 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daab1f-0dc0-4d61-815a-2095312b2eb7 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:26:59.904709 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c7215-8741-4631-ac80-20186bc37360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:26:59.905310 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c7215-8741-4631-ac80-20186bc37360 service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:26:59.905590 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c7215-8741-4631-ac80-20186bc37360 service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:26:59.905863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c7215-8741-4631-ac80-20186bc37360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:26:59.915284 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c7215-8741-4631-ac80-20186bc37360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:26:59.916762 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c7215-8741-4631-ac80-20186bc37360 service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:26:59.926497 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 519/1069] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:26:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:27:02.232821 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393e502-f950-4e1e-8e92-33678cc0453d None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:02.233332 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393e502-f950-4e1e-8e92-33678cc0453d None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:02.233332 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393e502-f950-4e1e-8e92-33678cc0453d None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:02.234629 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 551/1070] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:27:02.239887 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00e353-f479-475b-ad98-4bafa0815195 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:02.240335 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00e353-f479-475b-ad98-4bafa0815195 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:02.240433 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00e353-f479-475b-ad98-4bafa0815195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:02.260893 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-7b00e353-f479-475b-ad98-4bafa0815195 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:27:02.262113 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-7b00e353-f479-475b-ad98-4bafa0815195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:27:02.270323 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 520/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:27:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:27:02.615140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393e502-f950-4e1e-8e92-33678cc0453d None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:27:02.626520 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393e502-f950-4e1e-8e92-33678cc0453d None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:27:02.630041 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16b9f8-8f27-4d9d-9e29-0fb7de63b11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:27:02.630640 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b9f8-8f27-4d9d-9e29-0fb7de63b11c service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:02.631035 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b9f8-8f27-4d9d-9e29-0fb7de63b11c service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:02.631452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16b9f8-8f27-4d9d-9e29-0fb7de63b11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:02.641121 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16b9f8-8f27-4d9d-9e29-0fb7de63b11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:27:02.642623 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16b9f8-8f27-4d9d-9e29-0fb7de63b11c service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:27:02.653076 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 552/1072] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:27:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:27:04.934168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848ce32-50e4-4422-9ea6-837cff4ac8d2 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:04.934711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848ce32-50e4-4422-9ea6-837cff4ac8d2 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:04.934711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848ce32-50e4-4422-9ea6-837cff4ac8d2 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:04.936050 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 521/1073] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:27:04.941428 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68db4fa-8819-445f-9978-140038920cf6 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:04.941911 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68db4fa-8819-445f-9978-140038920cf6 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:04.942021 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68db4fa-8819-445f-9978-140038920cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:04.962149 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-b68db4fa-8819-445f-9978-140038920cf6 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:27:04.963374 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-b68db4fa-8819-445f-9978-140038920cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:27:04.971335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 553/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:27:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:27:05.323216 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848ce32-50e4-4422-9ea6-837cff4ac8d2 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:27:05.334088 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848ce32-50e4-4422-9ea6-837cff4ac8d2 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:27:05.338591 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebbcb4-892f-4e45-a397-ff2f74a8edf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:27:05.339190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebbcb4-892f-4e45-a397-ff2f74a8edf4 service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:05.339466 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebbcb4-892f-4e45-a397-ff2f74a8edf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:05.339734 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebbcb4-892f-4e45-a397-ff2f74a8edf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:05.349284 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebbcb4-892f-4e45-a397-ff2f74a8edf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:27:05.351647 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebbcb4-892f-4e45-a397-ff2f74a8edf4 service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:27:05.361856 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 522/1075] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:27:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:27:07.635177 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab2b97-f3da-4203-a7c5-717ed003d4f9 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:07.635720 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab2b97-f3da-4203-a7c5-717ed003d4f9 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:07.635720 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab2b97-f3da-4203-a7c5-717ed003d4f9 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:07.637161 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 554/1076] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:27:07.642832 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded7d27-5fcc-427b-80f4-acd1764b6957 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:07.643241 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded7d27-5fcc-427b-80f4-acd1764b6957 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:07.643371 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded7d27-5fcc-427b-80f4-acd1764b6957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:07.651442 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=70 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:07.663566 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-2ded7d27-5fcc-427b-80f4-acd1764b6957 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:27:07.671969 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-2ded7d27-5fcc-427b-80f4-acd1764b6957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:27:07.672657 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 523/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:27:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:27:08.031422 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab2b97-f3da-4203-a7c5-717ed003d4f9 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:27:08.036795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=72 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:08.043571 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab2b97-f3da-4203-a7c5-717ed003d4f9 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:27:08.047169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de2649-b116-4d62-9476-2ce95a2acddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:27:08.047705 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de2649-b116-4d62-9476-2ce95a2acddc service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:08.047990 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de2649-b116-4d62-9476-2ce95a2acddc service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:08.048260 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de2649-b116-4d62-9476-2ce95a2acddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:08.060095 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de2649-b116-4d62-9476-2ce95a2acddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:27:08.061902 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de2649-b116-4d62-9476-2ce95a2acddc service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:27:08.074359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 555/1078] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:27:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:27:10.387351 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6606f7f-8bf4-4fd0-af28-6f3fc796d4ac None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:10.387977 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6606f7f-8bf4-4fd0-af28-6f3fc796d4ac None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:10.387977 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6606f7f-8bf4-4fd0-af28-6f3fc796d4ac None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:10.389274 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 524/1079] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:27:10.394687 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84938679-8f72-489c-b2de-73c8b233e1fe None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:10.395134 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84938679-8f72-489c-b2de-73c8b233e1fe None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:10.395247 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84938679-8f72-489c-b2de-73c8b233e1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:10.416213 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-84938679-8f72-489c-b2de-73c8b233e1fe None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:27:10.417443 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-84938679-8f72-489c-b2de-73c8b233e1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:27:10.425285 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 556/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:27:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:27:10.769540 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6606f7f-8bf4-4fd0-af28-6f3fc796d4ac None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:27:10.780982 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6606f7f-8bf4-4fd0-af28-6f3fc796d4ac None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:27:10.784488 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583a94d-06d9-4374-9ca2-b3d8156a4cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:27:10.785128 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583a94d-06d9-4374-9ca2-b3d8156a4cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:10.785404 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583a94d-06d9-4374-9ca2-b3d8156a4cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:10.785674 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583a94d-06d9-4374-9ca2-b3d8156a4cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:10.795513 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583a94d-06d9-4374-9ca2-b3d8156a4cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:27:10.797063 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e583a94d-06d9-4374-9ca2-b3d8156a4cc1 service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:27:10.807585 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 525/1081] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:27:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:27:13.077206 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0da6a-5ce1-4d56-a499-535baa8f4e1f None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:13.077851 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0da6a-5ce1-4d56-a499-535baa8f4e1f None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:13.077851 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0da6a-5ce1-4d56-a499-535baa8f4e1f None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:13.079114 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 557/1082] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:27:13.085159 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd15ae-3cd8-4c1d-83c5-5493e0513be1 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:13.085630 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd15ae-3cd8-4c1d-83c5-5493e0513be1 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:13.085741 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd15ae-3cd8-4c1d-83c5-5493e0513be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:13.106152 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-56fd15ae-3cd8-4c1d-83c5-5493e0513be1 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:27:13.107368 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-56fd15ae-3cd8-4c1d-83c5-5493e0513be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:27:13.115890 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 526/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:27:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:27:13.461952 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0da6a-5ce1-4d56-a499-535baa8f4e1f None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:27:13.472853 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0da6a-5ce1-4d56-a499-535baa8f4e1f None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:27:13.477370 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88ef34-b5a5-4b26-9fd9-559a5d67fd08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:27:13.478000 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ef34-b5a5-4b26-9fd9-559a5d67fd08 service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:13.478280 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ef34-b5a5-4b26-9fd9-559a5d67fd08 service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:13.478551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88ef34-b5a5-4b26-9fd9-559a5d67fd08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:13.487560 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88ef34-b5a5-4b26-9fd9-559a5d67fd08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:27:13.489037 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88ef34-b5a5-4b26-9fd9-559a5d67fd08 service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:27:13.498736 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 558/1084] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:27:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:27:15.713255 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2d910-5e53-4da0-9766-6cd34163453a None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:15.716302 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2d910-5e53-4da0-9766-6cd34163453a None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:15.716302 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2d910-5e53-4da0-9766-6cd34163453a None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:15.716302 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 527/1085] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:27:15.720716 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8a62c-d29b-4db8-bf42-035b5a92ea24 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:15.721216 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8a62c-d29b-4db8-bf42-035b5a92ea24 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:15.721320 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8a62c-d29b-4db8-bf42-035b5a92ea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:15.741830 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-15c8a62c-d29b-4db8-bf42-035b5a92ea24 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:27:15.743048 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-15c8a62c-d29b-4db8-bf42-035b5a92ea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:27:15.750912 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 559/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:27:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:27:16.096832 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2d910-5e53-4da0-9766-6cd34163453a None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:27:16.107773 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2d910-5e53-4da0-9766-6cd34163453a None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:27:16.111218 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990f57a-c5fc-4080-821b-319f99c1622e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:27:16.111819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990f57a-c5fc-4080-821b-319f99c1622e service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:16.112093 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990f57a-c5fc-4080-821b-319f99c1622e service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:16.112362 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990f57a-c5fc-4080-821b-319f99c1622e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:16.122089 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990f57a-c5fc-4080-821b-319f99c1622e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:27:16.123525 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990f57a-c5fc-4080-821b-319f99c1622e service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:27:16.133642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 528/1087] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:27:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:27:25.736430 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=17 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:26.128800 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=17 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:27:40.695329 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089adf4e-0faf-4a90-9f41-e8a12a05bbdc None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:40.696096 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089adf4e-0faf-4a90-9f41-e8a12a05bbdc None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:40.696096 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089adf4e-0faf-4a90-9f41-e8a12a05bbdc None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:40.697263 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 560/1088] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:27:40.702659 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a90f72-c960-4f60-aeb6-b74a325d8539 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:40.703150 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a90f72-c960-4f60-aeb6-b74a325d8539 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:40.703253 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a90f72-c960-4f60-aeb6-b74a325d8539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:40.723667 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-05a90f72-c960-4f60-aeb6-b74a325d8539 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:27:40.724921 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-05a90f72-c960-4f60-aeb6-b74a325d8539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:27:40.732840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 529/1089] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:27:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:27:41.103306 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87b55c-cd04-4221-8ed7-c36f107e3cab None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:41.103590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87b55c-cd04-4221-8ed7-c36f107e3cab None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:41.103866 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87b55c-cd04-4221-8ed7-c36f107e3cab None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:41.105259 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 561/1090] 10.222.0.43 () {54 vars in 961 bytes} [Sat Sep 3 21:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:27:41.110953 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236c7b4-9fa4-42b6-9015-9886d9ee7441 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:41.111242 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236c7b4-9fa4-42b6-9015-9886d9ee7441 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:41.111521 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236c7b4-9fa4-42b6-9015-9886d9ee7441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:41.131719 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-e236c7b4-9fa4-42b6-9015-9886d9ee7441 None None] MFA Rules not processed for user `c05e9121d1bc48d497410de13a07b198`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:27:41.132981 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-e236c7b4-9fa4-42b6-9015-9886d9ee7441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:27:41.139873 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 530/1091] 10.222.0.43 () {58 vars in 1058 bytes} [Sat Sep 3 21:27:41 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:27:41.148496 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87b55c-cd04-4221-8ed7-c36f107e3cab None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:27:41.161271 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87b55c-cd04-4221-8ed7-c36f107e3cab None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:27:41.165821 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c647c3-5c91-4409-b5ad-aaadb7e7dde1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05e9121d1bc48d497410de13a07b198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:27:41.166428 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c647c3-5c91-4409-b5ad-aaadb7e7dde1 service glance] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:41.166707 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c647c3-5c91-4409-b5ad-aaadb7e7dde1 service glance] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:41.166981 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c647c3-5c91-4409-b5ad-aaadb7e7dde1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:41.177024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c647c3-5c91-4409-b5ad-aaadb7e7dde1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:27:41.178465 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c647c3-5c91-4409-b5ad-aaadb7e7dde1 service glance] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:27:41.188331 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 562/1092] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:27:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:27:43.491953 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13ab3-b7a7-4d42-af32-4416ef5c9c37 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:43.492587 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13ab3-b7a7-4d42-af32-4416ef5c9c37 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:43.492587 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13ab3-b7a7-4d42-af32-4416ef5c9c37 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:43.493846 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 531/1093] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:27:43.499390 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b3f44-f393-4b62-aee9-f6747ea3a012 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:43.499919 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b3f44-f393-4b62-aee9-f6747ea3a012 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:43.499919 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b3f44-f393-4b62-aee9-f6747ea3a012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:43.520663 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-491b3f44-f393-4b62-aee9-f6747ea3a012 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:27:43.521915 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-491b3f44-f393-4b62-aee9-f6747ea3a012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:27:43.529643 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 563/1094] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:27:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:27:43.857843 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d13ab3-b7a7-4d42-af32-4416ef5c9c37 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:27:43.870436 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d13ab3-b7a7-4d42-af32-4416ef5c9c37 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:27:43.874837 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5134d6-e00d-4b68-9b25-fd49cf9e0997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:27:43.879858 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5134d6-e00d-4b68-9b25-fd49cf9e0997 admin admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:43.879858 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5134d6-e00d-4b68-9b25-fd49cf9e0997 admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:43.879858 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5134d6-e00d-4b68-9b25-fd49cf9e0997 admin admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:43.879858 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5134d6-e00d-4b68-9b25-fd49cf9e0997 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:27:43.879858 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: WARNING py.warnings [None req-1f5134d6-e00d-4b68-9b25-fd49cf9e0997 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:27:43.879858 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: warnings.warn(msg) Sep 03 21:27:43.879858 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: Sep 03 21:27:43.880547 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5134d6-e00d-4b68-9b25-fd49cf9e0997 admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:27:43.898954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 532/1095] 10.222.0.43 () {56 vars in 1108 bytes} [Sat Sep 3 21:27:43 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 21:27:46.156605 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665bc1-17b2-49f1-880f-a8ca4ef346f8 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:46.157220 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665bc1-17b2-49f1-880f-a8ca4ef346f8 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:46.157220 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19665bc1-17b2-49f1-880f-a8ca4ef346f8 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:46.158617 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 564/1096] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:27:46.165874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191067fc-8c98-443d-939d-a66b2c298b67 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:46.167776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191067fc-8c98-443d-939d-a66b2c298b67 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:46.167776 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191067fc-8c98-443d-939d-a66b2c298b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:46.186649 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-191067fc-8c98-443d-939d-a66b2c298b67 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:27:46.187875 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-191067fc-8c98-443d-939d-a66b2c298b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:27:46.196083 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 533/1097] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:27:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:27:46.564339 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19665bc1-17b2-49f1-880f-a8ca4ef346f8 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:27:46.578942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19665bc1-17b2-49f1-880f-a8ca4ef346f8 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:27:46.585313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a8ad1-b033-430f-8f98-299d06a00385 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:27:46.585925 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a8ad1-b033-430f-8f98-299d06a00385 service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:46.586205 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a8ad1-b033-430f-8f98-299d06a00385 service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:46.586476 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a8ad1-b033-430f-8f98-299d06a00385 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:46.595780 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a8ad1-b033-430f-8f98-299d06a00385 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:27:46.597408 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a8ad1-b033-430f-8f98-299d06a00385 service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:27:46.608324 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 565/1098] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:27:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 21:27:49.043918 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15df9-b3a3-4d75-a15e-2570757ca6ae None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:49.044480 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15df9-b3a3-4d75-a15e-2570757ca6ae None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:49.044480 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d15df9-b3a3-4d75-a15e-2570757ca6ae None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:49.045820 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 534/1099] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:27:49.051930 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce911a0-6768-4806-b7f6-7a9d5710c84b None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:49.052403 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce911a0-6768-4806-b7f6-7a9d5710c84b None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:49.052665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce911a0-6768-4806-b7f6-7a9d5710c84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:49.072842 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-5ce911a0-6768-4806-b7f6-7a9d5710c84b None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:27:49.074292 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-5ce911a0-6768-4806-b7f6-7a9d5710c84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:27:49.082879 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 566/1100] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:27:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:27:49.430012 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d15df9-b3a3-4d75-a15e-2570757ca6ae None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:27:49.441096 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d15df9-b3a3-4d75-a15e-2570757ca6ae None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:27:49.445284 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea49fe3-8763-4ed2-995f-fe8f2e9bb1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:27:49.445892 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea49fe3-8763-4ed2-995f-fe8f2e9bb1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:49.446173 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea49fe3-8763-4ed2-995f-fe8f2e9bb1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:49.446446 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea49fe3-8763-4ed2-995f-fe8f2e9bb1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:49.455747 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea49fe3-8763-4ed2-995f-fe8f2e9bb1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:27:49.457297 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea49fe3-8763-4ed2-995f-fe8f2e9bb1a9 service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:27:49.467565 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 535/1101] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:27:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:27:51.748181 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6d71f-2b38-43fe-b1b0-adb55de633d8 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:51.748860 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6d71f-2b38-43fe-b1b0-adb55de633d8 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:51.748860 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6d71f-2b38-43fe-b1b0-adb55de633d8 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:51.750231 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 567/1102] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:27:51.757792 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e778848-531e-4a50-a5fa-94d2172f61f5 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:51.757792 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e778848-531e-4a50-a5fa-94d2172f61f5 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:51.757792 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e778848-531e-4a50-a5fa-94d2172f61f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:51.776504 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-7e778848-531e-4a50-a5fa-94d2172f61f5 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:27:51.777815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-7e778848-531e-4a50-a5fa-94d2172f61f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:27:51.786475 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 536/1103] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:27:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:27:52.132155 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6d71f-2b38-43fe-b1b0-adb55de633d8 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:27:52.142895 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6d71f-2b38-43fe-b1b0-adb55de633d8 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:27:52.147175 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b261852-5b46-44ed-ad0d-f62e70c02698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:27:52.147792 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b261852-5b46-44ed-ad0d-f62e70c02698 service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:52.148069 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b261852-5b46-44ed-ad0d-f62e70c02698 service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:52.148335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b261852-5b46-44ed-ad0d-f62e70c02698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:52.157881 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b261852-5b46-44ed-ad0d-f62e70c02698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:27:52.159022 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b261852-5b46-44ed-ad0d-f62e70c02698 service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:27:52.169313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 568/1104] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:27:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:27:54.528147 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c17ce6-82e9-467d-80f6-196e60b52660 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:54.528740 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c17ce6-82e9-467d-80f6-196e60b52660 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:54.528740 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c17ce6-82e9-467d-80f6-196e60b52660 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:54.530052 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 537/1105] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:27:54.536007 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e16b0-6c77-4727-817a-55f5c893f946 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:54.536563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e16b0-6c77-4727-817a-55f5c893f946 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:54.536563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e16b0-6c77-4727-817a-55f5c893f946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:54.555299 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-e17e16b0-6c77-4727-817a-55f5c893f946 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:27:54.556469 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-e17e16b0-6c77-4727-817a-55f5c893f946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:27:54.564129 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 569/1106] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:27:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:27:54.914482 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c17ce6-82e9-467d-80f6-196e60b52660 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:27:54.925313 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c17ce6-82e9-467d-80f6-196e60b52660 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:27:54.929576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafeed2-fb12-4108-a5b0-b5f42a709089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:27:54.930179 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafeed2-fb12-4108-a5b0-b5f42a709089 service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:54.930523 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafeed2-fb12-4108-a5b0-b5f42a709089 service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:54.930725 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafeed2-fb12-4108-a5b0-b5f42a709089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:54.940184 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafeed2-fb12-4108-a5b0-b5f42a709089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:27:54.942682 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafeed2-fb12-4108-a5b0-b5f42a709089 service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:27:54.952636 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 538/1107] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:27:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:27:57.505782 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7fbb1-57b2-4249-a977-7cc2cc800a30 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:57.506360 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7fbb1-57b2-4249-a977-7cc2cc800a30 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:57.506360 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7fbb1-57b2-4249-a977-7cc2cc800a30 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:57.507679 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 570/1108] 10.222.0.43 () {54 vars in 927 bytes} [Sat Sep 3 21:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:27:57.513194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22c4d8-affd-4d6a-b864-991dcd9ffdda None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:57.513871 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22c4d8-affd-4d6a-b864-991dcd9ffdda None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:57.514031 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d22c4d8-affd-4d6a-b864-991dcd9ffdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:57.533872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-9d22c4d8-affd-4d6a-b864-991dcd9ffdda None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:27:57.536243 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-9d22c4d8-affd-4d6a-b864-991dcd9ffdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:27:57.544084 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 539/1109] 10.222.0.43 () {58 vars in 1024 bytes} [Sat Sep 3 21:27:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:27:57.900972 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7fbb1-57b2-4249-a977-7cc2cc800a30 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:27:57.911700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7fbb1-57b2-4249-a977-7cc2cc800a30 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:27:57.915319 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f15e38-82ad-4b24-b47e-14351a8df9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:27:57.915923 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f15e38-82ad-4b24-b47e-14351a8df9fc service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:27:57.916201 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f15e38-82ad-4b24-b47e-14351a8df9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:27:57.916467 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f15e38-82ad-4b24-b47e-14351a8df9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:27:57.926406 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f15e38-82ad-4b24-b47e-14351a8df9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:27:57.927838 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f15e38-82ad-4b24-b47e-14351a8df9fc service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:27:57.937436 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 571/1110] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:27:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:28:07.528842 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=33 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:28:07.933272 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=33 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:22.311190 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df201e-1790-470c-acb3-c895b9d23e0d None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:22.311793 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df201e-1790-470c-acb3-c895b9d23e0d None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:22.311793 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df201e-1790-470c-acb3-c895b9d23e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:22.333082 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-33df201e-1790-470c-acb3-c895b9d23e0d None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:29:22.334344 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-33df201e-1790-470c-acb3-c895b9d23e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:29:22.342382 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 540/1111] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:29:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:29:22.350908 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa176d07-97b8-4366-9559-ec0789ac503e None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:22.351468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa176d07-97b8-4366-9559-ec0789ac503e None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:22.351468 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa176d07-97b8-4366-9559-ec0789ac503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:22.370797 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-aa176d07-97b8-4366-9559-ec0789ac503e None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:29:22.372023 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-aa176d07-97b8-4366-9559-ec0789ac503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:29:22.380028 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 572/1112] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:29:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:29:22.384647 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df201e-1790-470c-acb3-c895b9d23e0d None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:29:22.395297 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df201e-1790-470c-acb3-c895b9d23e0d None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:29:22.399902 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6e594-8e7c-411e-aa40-fd91f2eb993b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:29:22.400508 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6e594-8e7c-411e-aa40-fd91f2eb993b admin admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:22.400814 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6e594-8e7c-411e-aa40-fd91f2eb993b admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:22.401091 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6e594-8e7c-411e-aa40-fd91f2eb993b admin admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:22.401731 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6e594-8e7c-411e-aa40-fd91f2eb993b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:29:22.402032 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6e594-8e7c-411e-aa40-fd91f2eb993b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:29:22.403057 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: WARNING py.warnings [None req-fda6e594-8e7c-411e-aa40-fd91f2eb993b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:29:22.403057 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: warnings.warn(msg) Sep 03 21:29:22.403057 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: Sep 03 21:29:22.403947 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6e594-8e7c-411e-aa40-fd91f2eb993b admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:29:22.416327 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 541/1113] 10.222.0.43 () {58 vars in 1153 bytes} [Sat Sep 3 21:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:29:22.424884 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa176d07-97b8-4366-9559-ec0789ac503e None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:29:22.434081 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa176d07-97b8-4366-9559-ec0789ac503e None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:29:22.438815 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4140e5-a9dc-45da-9d1f-d20c98fc4fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:29:22.439617 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4140e5-a9dc-45da-9d1f-d20c98fc4fcb admin admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:22.439902 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4140e5-a9dc-45da-9d1f-d20c98fc4fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:22.440171 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4140e5-a9dc-45da-9d1f-d20c98fc4fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:22.440822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4140e5-a9dc-45da-9d1f-d20c98fc4fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:29:22.442600 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: WARNING py.warnings [None req-1c4140e5-a9dc-45da-9d1f-d20c98fc4fcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:29:22.442600 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: warnings.warn(msg) Sep 03 21:29:22.442600 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: Sep 03 21:29:22.443806 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4140e5-a9dc-45da-9d1f-d20c98fc4fcb admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:29:22.587018 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 573/1114] 10.222.0.43 () {60 vars in 1153 bytes} [Sat Sep 3 21:29:22 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:29:22.591269 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6e594-8e7c-411e-aa40-fd91f2eb993b admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:29:22.601437 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6e594-8e7c-411e-aa40-fd91f2eb993b admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:29:22.659019 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498e198-54c7-4941-99c4-1fd770b9dd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:29:22.659591 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498e198-54c7-4941-99c4-1fd770b9dd9e admin admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:22.659880 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498e198-54c7-4941-99c4-1fd770b9dd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:22.660163 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498e198-54c7-4941-99c4-1fd770b9dd9e admin admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:22.660891 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498e198-54c7-4941-99c4-1fd770b9dd9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:29:22.661933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: WARNING py.warnings [None req-4498e198-54c7-4941-99c4-1fd770b9dd9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:29:22.661933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: warnings.warn(msg) Sep 03 21:29:22.661933 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: Sep 03 21:29:22.663320 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498e198-54c7-4941-99c4-1fd770b9dd9e admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:29:22.744945 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 542/1115] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Sep 3 21:29:22 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:29:22.749109 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4140e5-a9dc-45da-9d1f-d20c98fc4fcb admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:29:22.760683 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4140e5-a9dc-45da-9d1f-d20c98fc4fcb admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:29:22.765220 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210da5d-e250-45bb-af1a-7605f25b6b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:29:22.769637 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210da5d-e250-45bb-af1a-7605f25b6b86 admin admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:22.769637 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210da5d-e250-45bb-af1a-7605f25b6b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:22.769637 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210da5d-e250-45bb-af1a-7605f25b6b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:22.769637 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210da5d-e250-45bb-af1a-7605f25b6b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:29:22.769637 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: WARNING py.warnings [None req-d210da5d-e250-45bb-af1a-7605f25b6b86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:29:22.769637 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: warnings.warn(msg) Sep 03 21:29:22.769637 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: Sep 03 21:29:22.770191 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210da5d-e250-45bb-af1a-7605f25b6b86 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:29:22.785113 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 574/1116] 10.222.0.43 () {58 vars in 1122 bytes} [Sat Sep 3 21:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 21:29:22.790989 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498e198-54c7-4941-99c4-1fd770b9dd9e admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:29:22.799617 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498e198-54c7-4941-99c4-1fd770b9dd9e admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:29:22.804246 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aad643-631d-4aec-897e-f59623f3720f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:29:22.804873 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aad643-631d-4aec-897e-f59623f3720f admin admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:22.805151 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aad643-631d-4aec-897e-f59623f3720f admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:22.805418 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aad643-631d-4aec-897e-f59623f3720f admin admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:22.806084 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aad643-631d-4aec-897e-f59623f3720f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:29:22.807089 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: WARNING py.warnings [None req-b0aad643-631d-4aec-897e-f59623f3720f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:29:22.807089 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: warnings.warn(msg) Sep 03 21:29:22.807089 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: Sep 03 21:29:22.807970 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aad643-631d-4aec-897e-f59623f3720f admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:29:22.823288 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 543/1117] 10.222.0.43 () {58 vars in 1122 bytes} [Sat Sep 3 21:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 21:29:22.827646 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210da5d-e250-45bb-af1a-7605f25b6b86 admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:29:22.838875 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210da5d-e250-45bb-af1a-7605f25b6b86 admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:29:22.843311 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41359d5c-8015-46e0-8457-7a470008de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:29:22.850088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359d5c-8015-46e0-8457-7a470008de28 admin admin] REQUEST_METHOD: `PUT` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:22.850088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359d5c-8015-46e0-8457-7a470008de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:22.850088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359d5c-8015-46e0-8457-7a470008de28 admin admin] PATH_INFO: `/v3/projects/6bb50588aa914abcbb684a47d0705358/users/a0beb74dca3549dab98eb0594d1f1c82/roles/b7001437cbb84adc825e214c44d6e551` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:22.859397 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41359d5c-8015-46e0-8457-7a470008de28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bb50588aa914abcbb684a47d0705358, user_id=a0beb74dca3549dab98eb0594d1f1c82, role_id=b7001437cbb84adc825e214c44d6e551)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:29:22.861053 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: WARNING py.warnings [None req-41359d5c-8015-46e0-8457-7a470008de28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:29:22.861053 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: warnings.warn(msg) Sep 03 21:29:22.861053 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: Sep 03 21:29:22.863066 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41359d5c-8015-46e0-8457-7a470008de28 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:29:22.945146 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 575/1118] 10.222.0.43 () {60 vars in 1483 bytes} [Sat Sep 3 21:29:22 2022] PUT /identity/v3/projects/6bb50588aa914abcbb684a47d0705358/users/a0beb74dca3549dab98eb0594d1f1c82/roles/b7001437cbb84adc825e214c44d6e551 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:29:22.957454 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2587ee-e6e5-4751-9ec5-fcf49a18c7ef None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:22.957767 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2587ee-e6e5-4751-9ec5-fcf49a18c7ef None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:22.958050 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2587ee-e6e5-4751-9ec5-fcf49a18c7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:22.986962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-2b2587ee-e6e5-4751-9ec5-fcf49a18c7ef None None] MFA Rules not processed for user `a0beb74dca3549dab98eb0594d1f1c82`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:29:22.988274 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-2b2587ee-e6e5-4751-9ec5-fcf49a18c7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:29:23.053478 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 544/1119] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:29:22 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:29:23.067372 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa437d2-9417-4522-978d-ae3c09d44172 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:23.067681 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa437d2-9417-4522-978d-ae3c09d44172 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:23.067953 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa437d2-9417-4522-978d-ae3c09d44172 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:23.069434 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 576/1120] 10.222.0.43 () {54 vars in 964 bytes} [Sat Sep 3 21:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:29:23.074384 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dae397-43bb-4b70-bbc3-41b171cac86c None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:23.074674 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dae397-43bb-4b70-bbc3-41b171cac86c None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:23.074954 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dae397-43bb-4b70-bbc3-41b171cac86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:23.096228 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-56dae397-43bb-4b70-bbc3-41b171cac86c None None] MFA Rules not processed for user `90cd1e165f3c4eba95dc93a25011b695`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:29:23.097398 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-56dae397-43bb-4b70-bbc3-41b171cac86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:29:23.145463 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:23.153171 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 545/1121] 10.222.0.43 () {58 vars in 1061 bytes} [Sat Sep 3 21:29:23 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:29:23.161000 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa437d2-9417-4522-978d-ae3c09d44172 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:29:23.172229 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa437d2-9417-4522-978d-ae3c09d44172 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:29:23.176906 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273f8ca-86fa-45b5-a093-475419b9a988 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90cd1e165f3c4eba95dc93a25011b695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:29:23.177506 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273f8ca-86fa-45b5-a093-475419b9a988 service cinder] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:23.177878 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273f8ca-86fa-45b5-a093-475419b9a988 service cinder] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:23.178054 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273f8ca-86fa-45b5-a093-475419b9a988 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:23.186587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273f8ca-86fa-45b5-a093-475419b9a988 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:29:23.188143 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273f8ca-86fa-45b5-a093-475419b9a988 service cinder] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:29:23.199362 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 577/1122] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:29:23 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:29:23.238626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e404406-838c-4345-93fe-40fb0173c6d7 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:23.238910 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e404406-838c-4345-93fe-40fb0173c6d7 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:23.239182 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e404406-838c-4345-93fe-40fb0173c6d7 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:23.240457 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 546/1123] 10.222.0.43 () {52 vars in 830 bytes} [Sat Sep 3 21:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:29:23.244049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273f8ca-86fa-45b5-a093-475419b9a988 service cinder] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:29:23.305437 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273f8ca-86fa-45b5-a093-475419b9a988 service cinder] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:29:23.309898 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:29:23.310511 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:23.310790 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:23.311058 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] PATH_INFO: `/v3/users/a0beb74dca3549dab98eb0594d1f1c82` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:23.312223 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0beb74dca3549dab98eb0594d1f1c82)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:29:23.313265 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: WARNING py.warnings [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:29:23.313265 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: warnings.warn(msg) Sep 03 21:29:23.313265 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: Sep 03 21:29:23.314470 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:29:23.520487 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0beb74dca3549dab98eb0594d1f1c82'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:29:23.521267 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0beb74dca3549dab98eb0594d1f1c82'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:29:23.545104 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0beb74dca3549dab98eb0594d1f1c82'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:29:23.559824 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0beb74dca3549dab98eb0594d1f1c82'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:29:23.560581 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0beb74dca3549dab98eb0594d1f1c82'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:29:23.566398 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:23.653000 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 578/1124] 10.222.0.43 () {58 vars in 1224 bytes} [Sat Sep 3 21:29:23 2022] DELETE /identity/v3/users/a0beb74dca3549dab98eb0594d1f1c82 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:29:23.658207 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5a260-41d9-48ca-b898-6a1f00c227c9 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:23.665628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5a260-41d9-48ca-b898-6a1f00c227c9 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:23.665628 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5a260-41d9-48ca-b898-6a1f00c227c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:23.677922 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-08a5a260-41d9-48ca-b898-6a1f00c227c9 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:29:23.679119 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-08a5a260-41d9-48ca-b898-6a1f00c227c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:29:23.738859 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 547/1125] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:29:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:29:23.748361 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:29:23.749786 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:29:23.806328 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b048067-4388-499d-8525-13f76f441527 admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:29:23.809795 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40091772-38e7-4bf2-8367-f29216d61c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:29:23.810392 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40091772-38e7-4bf2-8367-f29216d61c7e service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:23.810668 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40091772-38e7-4bf2-8367-f29216d61c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:23.810937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40091772-38e7-4bf2-8367-f29216d61c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:23.825011 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40091772-38e7-4bf2-8367-f29216d61c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:29:23.826452 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40091772-38e7-4bf2-8367-f29216d61c7e service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:29:23.836838 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 579/1126] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:29:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:29:24.358094 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5a260-41d9-48ca-b898-6a1f00c227c9 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:29:24.359558 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-08a5a260-41d9-48ca-b898-6a1f00c227c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:29:24.372711 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5a260-41d9-48ca-b898-6a1f00c227c9 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:29:24.378184 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:29:24.378831 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:29:24.379111 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:29:24.379385 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0 admin admin] PATH_INFO: `/v3/projects/6bb50588aa914abcbb684a47d0705358` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:29:24.380514 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bb50588aa914abcbb684a47d0705358)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:29:24.381577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: WARNING py.warnings [None req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:29:24.381577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: warnings.warn(msg) Sep 03 21:29:24.381577 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: Sep 03 21:29:24.382832 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0 admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:29:24.512021 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bb50588aa914abcbb684a47d0705358', 'request_id': 'req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:29:24.526185 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bb50588aa914abcbb684a47d0705358', 'request_id': 'req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:29:24.533106 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bb50588aa914abcbb684a47d0705358', 'request_id': 'req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:29:24.631155 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0 admin admin] The token cache is being invalidate because project 6bb50588aa914abcbb684a47d0705358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 21:29:24.631354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:29:24.632076 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-ce4b1082-c6f7-44fb-8fdf-0c56eb5087e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:29:24.633631 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 548/1127] 10.222.0.43 () {58 vars in 1233 bytes} [Sat Sep 3 21:29:24 2022] DELETE /identity/v3/projects/6bb50588aa914abcbb684a47d0705358 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:29:33.832517 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:29:34.626469 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:30:45.718872 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d522401-d89b-4968-bb49-8df807992033 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:45.719491 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d522401-d89b-4968-bb49-8df807992033 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:45.719491 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d522401-d89b-4968-bb49-8df807992033 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:45.720792 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 580/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 21:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:30:45.725951 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581907c-8ccb-4624-81a2-4f7b78fb1be8 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:45.726414 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581907c-8ccb-4624-81a2-4f7b78fb1be8 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:45.726516 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581907c-8ccb-4624-81a2-4f7b78fb1be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:45.747386 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-e581907c-8ccb-4624-81a2-4f7b78fb1be8 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:30:45.748626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-e581907c-8ccb-4624-81a2-4f7b78fb1be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:30:45.811952 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 549/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 21:30:45 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:30:45.979280 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d522401-d89b-4968-bb49-8df807992033 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:30:45.981025 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-8d522401-d89b-4968-bb49-8df807992033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:30:46.058251 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d522401-d89b-4968-bb49-8df807992033 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:30:46.063216 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a44099-0797-49fe-8489-38df7ad0a1f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:30:46.063830 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a44099-0797-49fe-8489-38df7ad0a1f9 service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:46.064114 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a44099-0797-49fe-8489-38df7ad0a1f9 service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:46.064387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a44099-0797-49fe-8489-38df7ad0a1f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:46.074219 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a44099-0797-49fe-8489-38df7ad0a1f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:30:46.075816 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a44099-0797-49fe-8489-38df7ad0a1f9 service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:30:46.086389 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 581/1130] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:30:45 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:30:46.938912 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470462-da23-47c0-9cec-ce9df8e261f5 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:46.939509 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470462-da23-47c0-9cec-ce9df8e261f5 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:46.939509 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470462-da23-47c0-9cec-ce9df8e261f5 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:46.941032 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 550/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 21:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:30:46.946070 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8c24c-91da-44f2-aca7-90e815ef6089 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:46.946524 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8c24c-91da-44f2-aca7-90e815ef6089 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:46.946632 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8c24c-91da-44f2-aca7-90e815ef6089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:46.966811 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-c8b8c24c-91da-44f2-aca7-90e815ef6089 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:30:46.968049 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-c8b8c24c-91da-44f2-aca7-90e815ef6089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:30:46.976610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 582/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 21:30:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 21:30:47.136805 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24470462-da23-47c0-9cec-ce9df8e261f5 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:30:47.153765 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24470462-da23-47c0-9cec-ce9df8e261f5 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:30:47.158733 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863cb01-61a3-4119-8a47-ae2855a28961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:30:47.159334 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863cb01-61a3-4119-8a47-ae2855a28961 service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:47.159617 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863cb01-61a3-4119-8a47-ae2855a28961 service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:47.159893 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863cb01-61a3-4119-8a47-ae2855a28961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:47.168429 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863cb01-61a3-4119-8a47-ae2855a28961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:30:47.170064 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863cb01-61a3-4119-8a47-ae2855a28961 service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:30:47.179874 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 551/1133] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:30:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:30:51.789405 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2d8e1-6349-46ab-b173-81d3f3e7a307 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:51.790024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2d8e1-6349-46ab-b173-81d3f3e7a307 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:51.790024 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2d8e1-6349-46ab-b173-81d3f3e7a307 None None] PATH_INFO: `/v3` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:51.791303 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 583/1134] 10.222.0.45 () {54 vars in 925 bytes} [Sat Sep 3 21:30:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 03 21:30:51.797374 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246502cc-654a-4a5e-b941-02998cd842ee None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:51.797988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246502cc-654a-4a5e-b941-02998cd842ee None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:51.797988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246502cc-654a-4a5e-b941-02998cd842ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:51.833085 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-246502cc-654a-4a5e-b941-02998cd842ee None None] MFA Rules not processed for user `5fb45f9358b64974a39d996e93e5c105`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:30:51.834311 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-246502cc-654a-4a5e-b941-02998cd842ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:30:51.898753 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 552/1135] 10.222.0.45 () {58 vars in 1015 bytes} [Sat Sep 3 21:30:51 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:30:56.406358 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda9165-5061-4ef2-b757-44355bbaea01 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:56.406936 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda9165-5061-4ef2-b757-44355bbaea01 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:56.406936 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda9165-5061-4ef2-b757-44355bbaea01 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:56.409070 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 584/1136] 10.222.0.43 () {54 vars in 961 bytes} [Sat Sep 3 21:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:30:56.414779 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746e93e-968b-4d98-b1d1-b9e0e19ebdb5 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:56.415304 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746e93e-968b-4d98-b1d1-b9e0e19ebdb5 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:56.415407 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746e93e-968b-4d98-b1d1-b9e0e19ebdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:56.437709 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-1746e93e-968b-4d98-b1d1-b9e0e19ebdb5 None None] MFA Rules not processed for user `5fb45f9358b64974a39d996e93e5c105`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:30:56.438991 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-1746e93e-968b-4d98-b1d1-b9e0e19ebdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:30:56.447733 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 553/1137] 10.222.0.43 () {58 vars in 1058 bytes} [Sat Sep 3 21:30:56 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:30:56.455443 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda9165-5061-4ef2-b757-44355bbaea01 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:30:56.469039 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda9165-5061-4ef2-b757-44355bbaea01 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:30:56.474829 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde76b51-b598-46fa-bcc0-8f2f9d392615 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb45f9358b64974a39d996e93e5c105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:30:56.475436 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76b51-b598-46fa-bcc0-8f2f9d392615 service placement] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:56.475713 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76b51-b598-46fa-bcc0-8f2f9d392615 service placement] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:56.475981 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76b51-b598-46fa-bcc0-8f2f9d392615 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:56.485035 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde76b51-b598-46fa-bcc0-8f2f9d392615 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:30:56.487290 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde76b51-b598-46fa-bcc0-8f2f9d392615 service placement] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:30:56.497198 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 585/1138] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:30:56 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:30:58.496658 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aa002-01a4-46be-9a33-3b2994ad1ac8 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:58.497286 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aa002-01a4-46be-9a33-3b2994ad1ac8 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:58.497286 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742aa002-01a4-46be-9a33-3b2994ad1ac8 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:58.498523 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 554/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 21:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:30:58.505783 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756bafb-6ddd-4391-a1f7-9857b246e359 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:58.506268 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756bafb-6ddd-4391-a1f7-9857b246e359 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:58.506394 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756bafb-6ddd-4391-a1f7-9857b246e359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:58.530273 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-3756bafb-6ddd-4391-a1f7-9857b246e359 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:30:58.531494 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-3756bafb-6ddd-4391-a1f7-9857b246e359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:30:58.540848 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 586/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 21:30:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:30:58.707875 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742aa002-01a4-46be-9a33-3b2994ad1ac8 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:30:58.723104 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742aa002-01a4-46be-9a33-3b2994ad1ac8 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:30:58.728196 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54325e-c0c1-405e-8c4b-b6fc3dc5931e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:30:58.728870 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54325e-c0c1-405e-8c4b-b6fc3dc5931e service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:58.729148 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54325e-c0c1-405e-8c4b-b6fc3dc5931e service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:58.729411 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54325e-c0c1-405e-8c4b-b6fc3dc5931e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:58.740075 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54325e-c0c1-405e-8c4b-b6fc3dc5931e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:30:58.741738 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54325e-c0c1-405e-8c4b-b6fc3dc5931e service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:30:58.753323 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 555/1141] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:30:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:30:59.655303 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38bd8-1ac0-41ab-8474-f25caa383270 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:59.655937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38bd8-1ac0-41ab-8474-f25caa383270 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:59.655937 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38bd8-1ac0-41ab-8474-f25caa383270 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:59.657290 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 587/1142] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 3 21:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:30:59.663610 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3c04a-99d0-49bb-a997-c3342e3628aa None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:59.664218 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3c04a-99d0-49bb-a997-c3342e3628aa None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:59.664218 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3c04a-99d0-49bb-a997-c3342e3628aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:59.685414 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-2ca3c04a-99d0-49bb-a997-c3342e3628aa None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:30:59.687279 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-2ca3c04a-99d0-49bb-a997-c3342e3628aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:30:59.695565 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 556/1143] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 3 21:30:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:30:59.863285 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b38bd8-1ac0-41ab-8474-f25caa383270 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:30:59.877983 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b38bd8-1ac0-41ab-8474-f25caa383270 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:30:59.883363 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbaf421-df67-4beb-b4fa-f3793a8c65b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:30:59.883989 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaf421-df67-4beb-b4fa-f3793a8c65b5 service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:30:59.884278 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaf421-df67-4beb-b4fa-f3793a8c65b5 service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:30:59.884575 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaf421-df67-4beb-b4fa-f3793a8c65b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:30:59.894471 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbaf421-df67-4beb-b4fa-f3793a8c65b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:30:59.896104 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbaf421-df67-4beb-b4fa-f3793a8c65b5 service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:30:59.908081 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 588/1144] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:30:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 21:31:04.075143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a719f9-ff6e-406b-88cb-4f35b31bf032 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:31:04.075756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a719f9-ff6e-406b-88cb-4f35b31bf032 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:31:04.075756 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a719f9-ff6e-406b-88cb-4f35b31bf032 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:31:04.077189 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 557/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:31:04.083723 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4e4c7-cdab-41f3-8bc4-bf19d7479ef0 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:31:04.094872 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4e4c7-cdab-41f3-8bc4-bf19d7479ef0 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:31:04.094872 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4e4c7-cdab-41f3-8bc4-bf19d7479ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:31:04.105388 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-63d4e4c7-cdab-41f3-8bc4-bf19d7479ef0 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:31:04.106745 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-63d4e4c7-cdab-41f3-8bc4-bf19d7479ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:31:04.115850 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 589/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:31:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:31:04.498697 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a719f9-ff6e-406b-88cb-4f35b31bf032 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:31:04.500582 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-08a719f9-ff6e-406b-88cb-4f35b31bf032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:31:04.556750 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=100 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:31:04.562203 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a719f9-ff6e-406b-88cb-4f35b31bf032 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:31:04.566513 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac859f1-2a39-4848-9dec-3c3e487f3f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:31:04.567118 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac859f1-2a39-4848-9dec-3c3e487f3f10 service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:31:04.567398 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac859f1-2a39-4848-9dec-3c3e487f3f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:31:04.567694 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac859f1-2a39-4848-9dec-3c3e487f3f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:31:04.577655 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac859f1-2a39-4848-9dec-3c3e487f3f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:31:04.580297 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac859f1-2a39-4848-9dec-3c3e487f3f10 service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:31:04.589899 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 558/1147] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:31:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:31:06.902833 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277c113-4372-4e65-a6fc-d048f511b053 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:31:06.903412 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277c113-4372-4e65-a6fc-d048f511b053 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:31:06.903412 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277c113-4372-4e65-a6fc-d048f511b053 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:31:06.904823 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 590/1148] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:31:06.910832 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15719499-d72c-4648-9c8b-7e420a7a7357 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:31:06.911438 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15719499-d72c-4648-9c8b-7e420a7a7357 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:31:06.911438 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15719499-d72c-4648-9c8b-7e420a7a7357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:31:06.937152 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-15719499-d72c-4648-9c8b-7e420a7a7357 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:31:06.938456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-15719499-d72c-4648-9c8b-7e420a7a7357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:31:06.947616 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 559/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:31:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:31:07.311204 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277c113-4372-4e65-a6fc-d048f511b053 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:31:07.313624 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-b277c113-4372-4e65-a6fc-d048f511b053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:31:07.328785 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277c113-4372-4e65-a6fc-d048f511b053 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:31:07.333086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21da69-dff5-4397-b3da-6f0d40e64cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:31:07.333719 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21da69-dff5-4397-b3da-6f0d40e64cee service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:31:07.333992 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21da69-dff5-4397-b3da-6f0d40e64cee service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:31:07.334372 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21da69-dff5-4397-b3da-6f0d40e64cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:31:07.344498 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21da69-dff5-4397-b3da-6f0d40e64cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:31:07.347167 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21da69-dff5-4397-b3da-6f0d40e64cee service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:31:07.358117 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 591/1150] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:31:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 21:31:11.273930 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2508373-e102-455e-a218-4552a5781be6 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:31:11.274950 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2508373-e102-455e-a218-4552a5781be6 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:31:11.274950 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2508373-e102-455e-a218-4552a5781be6 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:31:11.275919 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 560/1151] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:31:11.281994 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d1142-d68f-4cf0-8617-4ad7f6f9f4bc None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:31:11.283362 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d1142-d68f-4cf0-8617-4ad7f6f9f4bc None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:31:11.283362 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d1142-d68f-4cf0-8617-4ad7f6f9f4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:31:11.306301 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-7c0d1142-d68f-4cf0-8617-4ad7f6f9f4bc None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:31:11.307561 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-7c0d1142-d68f-4cf0-8617-4ad7f6f9f4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:31:11.316954 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 592/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:31:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:31:11.927532 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2508373-e102-455e-a218-4552a5781be6 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:31:11.933566 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-a2508373-e102-455e-a218-4552a5781be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:31:11.999241 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2508373-e102-455e-a218-4552a5781be6 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:31:12.003879 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7808d9d-ff7b-4526-872f-3d8644236832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90cd1e165f3c4eba95dc93a25011b695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:31:12.004551 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7808d9d-ff7b-4526-872f-3d8644236832 service cinder] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:31:12.004894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7808d9d-ff7b-4526-872f-3d8644236832 service cinder] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:31:12.005164 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7808d9d-ff7b-4526-872f-3d8644236832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:31:12.016376 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7808d9d-ff7b-4526-872f-3d8644236832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:31:12.019092 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7808d9d-ff7b-4526-872f-3d8644236832 service cinder] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:31:12.029962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 561/1153] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:31:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 21:31:14.417098 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442736ba-5fc7-4f5c-b64d-c231c9d4229e None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:31:14.418075 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442736ba-5fc7-4f5c-b64d-c231c9d4229e None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:31:14.418075 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442736ba-5fc7-4f5c-b64d-c231c9d4229e None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:31:14.419086 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 593/1154] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 3 21:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:31:14.425498 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05055834-5679-4a8f-94b2-1937bda574b8 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:31:14.426105 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05055834-5679-4a8f-94b2-1937bda574b8 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:31:14.426105 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05055834-5679-4a8f-94b2-1937bda574b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:31:14.448309 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-05055834-5679-4a8f-94b2-1937bda574b8 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:31:14.449588 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-05055834-5679-4a8f-94b2-1937bda574b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:31:14.459221 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 562/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 3 21:31:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:31:15.078694 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442736ba-5fc7-4f5c-b64d-c231c9d4229e None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:31:15.081179 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-442736ba-5fc7-4f5c-b64d-c231c9d4229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:31:15.092299 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=63 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:31:15.098793 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442736ba-5fc7-4f5c-b64d-c231c9d4229e None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:31:15.102585 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd537cb9-1eb8-4e1b-bb90-768b01c7ea8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90cd1e165f3c4eba95dc93a25011b695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:31:15.103216 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537cb9-1eb8-4e1b-bb90-768b01c7ea8d service cinder] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:31:15.103496 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537cb9-1eb8-4e1b-bb90-768b01c7ea8d service cinder] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:31:15.103763 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537cb9-1eb8-4e1b-bb90-768b01c7ea8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:31:15.114554 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd537cb9-1eb8-4e1b-bb90-768b01c7ea8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:31:15.116065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd537cb9-1eb8-4e1b-bb90-768b01c7ea8d service cinder] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:31:15.127289 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 594/1156] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:31:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:31:24.441928 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=37 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:31:25.122639 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=5 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:29.657137 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a1f64-cb3a-4f15-aace-38081874c251 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:29.658417 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a1f64-cb3a-4f15-aace-38081874c251 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:29.658417 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a1f64-cb3a-4f15-aace-38081874c251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:29.674889 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc74b1-dfa3-422c-91ad-e19b9f995733 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:29.675549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc74b1-dfa3-422c-91ad-e19b9f995733 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:29.675549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc74b1-dfa3-422c-91ad-e19b9f995733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:29.678461 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-e09a1f64-cb3a-4f15-aace-38081874c251 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:29.679679 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-e09a1f64-cb3a-4f15-aace-38081874c251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:29.687464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 563/1157] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:32:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:32:29.696416 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df84ef-df3e-4f90-a22c-312457414203 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:29.698046 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-48cc74b1-dfa3-422c-91ad-e19b9f995733 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:29.698168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df84ef-df3e-4f90-a22c-312457414203 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:29.698168 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df84ef-df3e-4f90-a22c-312457414203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:29.702446 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-48cc74b1-dfa3-422c-91ad-e19b9f995733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:29.711812 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 595/1158] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:32:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 21:32:29.720252 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-b3df84ef-df3e-4f90-a22c-312457414203 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:29.720446 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7a266-f276-436e-a3d0-9ecf9e65501e None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:29.720446 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7a266-f276-436e-a3d0-9ecf9e65501e None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:29.720446 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7a266-f276-436e-a3d0-9ecf9e65501e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:29.720894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-b3df84ef-df3e-4f90-a22c-312457414203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:29.728818 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 564/1159] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:32:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 21:32:29.733453 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df84ef-df3e-4f90-a22c-312457414203 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:29.741301 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-3ef7a266-f276-436e-a3d0-9ecf9e65501e None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:29.742544 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-3ef7a266-f276-436e-a3d0-9ecf9e65501e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:29.744971 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df84ef-df3e-4f90-a22c-312457414203 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:29.749883 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f400d-bdf9-4a67-9d53-7899c29740ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:29.751143 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f400d-bdf9-4a67-9d53-7899c29740ad admin admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:29.751518 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f400d-bdf9-4a67-9d53-7899c29740ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:29.751790 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f400d-bdf9-4a67-9d53-7899c29740ad admin admin] PATH_INFO: `/v3/domains` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:29.752359 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 596/1160] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:32:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 21:32:29.752509 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f400d-bdf9-4a67-9d53-7899c29740ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88384) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:32:29.756357 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f400d-bdf9-4a67-9d53-7899c29740ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:29.757227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7a266-f276-436e-a3d0-9ecf9e65501e None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:29.758339 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f400d-bdf9-4a67-9d53-7899c29740ad admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:29.767320 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7a266-f276-436e-a3d0-9ecf9e65501e None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:29.772124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b0f2a-d8c7-4d70-9164-d609d7484229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:29.772293 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 565/1161] 10.222.0.43 () {58 vars in 1153 bytes} [Sat Sep 3 21:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:32:29.772756 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b0f2a-d8c7-4d70-9164-d609d7484229 admin admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:29.773059 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b0f2a-d8c7-4d70-9164-d609d7484229 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:29.773294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b0f2a-d8c7-4d70-9164-d609d7484229 admin admin] PATH_INFO: `/v3/domains` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:29.773931 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b0f2a-d8c7-4d70-9164-d609d7484229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88385) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 03 21:32:29.774233 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b0f2a-d8c7-4d70-9164-d609d7484229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:29.775255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: WARNING py.warnings [None req-886b0f2a-d8c7-4d70-9164-d609d7484229 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:32:29.775255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: warnings.warn(msg) Sep 03 21:32:29.775255 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: Sep 03 21:32:29.776141 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b0f2a-d8c7-4d70-9164-d609d7484229 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:29.780196 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f400d-bdf9-4a67-9d53-7899c29740ad admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:29.789475 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 597/1162] 10.222.0.43 () {58 vars in 1153 bytes} [Sat Sep 3 21:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 03 21:32:29.791032 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f400d-bdf9-4a67-9d53-7899c29740ad admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:29.795847 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f96415-fb29-4751-8fe5-0f2275a9cc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:29.796459 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96415-fb29-4751-8fe5-0f2275a9cc55 admin admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:29.796777 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96415-fb29-4751-8fe5-0f2275a9cc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:29.797928 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96415-fb29-4751-8fe5-0f2275a9cc55 admin admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:29.799106 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f96415-fb29-4751-8fe5-0f2275a9cc55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:29.799228 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b0f2a-d8c7-4d70-9164-d609d7484229 admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:29.800135 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: WARNING py.warnings [None req-21f96415-fb29-4751-8fe5-0f2275a9cc55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:32:29.800135 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: warnings.warn(msg) Sep 03 21:32:29.800135 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: Sep 03 21:32:29.801380 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f96415-fb29-4751-8fe5-0f2275a9cc55 admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:29.810435 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b0f2a-d8c7-4d70-9164-d609d7484229 admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:29.817551 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cae5a-63cb-495b-a2d8-1b122fcd5dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:29.818172 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cae5a-63cb-495b-a2d8-1b122fcd5dcd admin admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:29.818449 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cae5a-63cb-495b-a2d8-1b122fcd5dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:29.818746 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cae5a-63cb-495b-a2d8-1b122fcd5dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:29.819404 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cae5a-63cb-495b-a2d8-1b122fcd5dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:29.821364 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cae5a-63cb-495b-a2d8-1b122fcd5dcd admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:29.931309 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 566/1163] 10.222.0.43 () {60 vars in 1153 bytes} [Sat Sep 3 21:32:29 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 21:32:29.932336 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 598/1164] 10.222.0.43 () {60 vars in 1153 bytes} [Sat Sep 3 21:32:29 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:32:29.935840 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f96415-fb29-4751-8fe5-0f2275a9cc55 admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:29.936485 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cae5a-63cb-495b-a2d8-1b122fcd5dcd admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:30.004400 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cae5a-63cb-495b-a2d8-1b122fcd5dcd admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:30.007818 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f96415-fb29-4751-8fe5-0f2275a9cc55 admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:30.010570 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fb157-1aaa-415f-adce-b7a1db8172ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:30.011171 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fb157-1aaa-415f-adce-b7a1db8172ff admin admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:30.011522 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fb157-1aaa-415f-adce-b7a1db8172ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:30.011740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fb157-1aaa-415f-adce-b7a1db8172ff admin admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:30.012377 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fb157-1aaa-415f-adce-b7a1db8172ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:30.012965 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc510d3e-2e40-402a-9cc6-292fcf273a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:30.013791 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: WARNING py.warnings [None req-540fb157-1aaa-415f-adce-b7a1db8172ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:32:30.013791 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: warnings.warn(msg) Sep 03 21:32:30.013791 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: Sep 03 21:32:30.014028 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510d3e-2e40-402a-9cc6-292fcf273a35 admin admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:30.014214 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510d3e-2e40-402a-9cc6-292fcf273a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:30.014408 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510d3e-2e40-402a-9cc6-292fcf273a35 admin admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:30.015065 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fb157-1aaa-415f-adce-b7a1db8172ff admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:30.015717 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc510d3e-2e40-402a-9cc6-292fcf273a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:30.017151 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc510d3e-2e40-402a-9cc6-292fcf273a35 admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:30.120587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 599/1165] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Sep 3 21:32:29 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 21:32:30.124680 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fb157-1aaa-415f-adce-b7a1db8172ff admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:30.135807 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fb157-1aaa-415f-adce-b7a1db8172ff admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:30.141312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb946f-dafd-4c5e-8ff4-31c7aa4ea634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:30.141930 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb946f-dafd-4c5e-8ff4-31c7aa4ea634 admin admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:30.142213 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb946f-dafd-4c5e-8ff4-31c7aa4ea634 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:30.142515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb946f-dafd-4c5e-8ff4-31c7aa4ea634 admin admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:30.143264 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb946f-dafd-4c5e-8ff4-31c7aa4ea634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:30.144943 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb946f-dafd-4c5e-8ff4-31c7aa4ea634 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:30.148979 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 567/1166] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Sep 3 21:32:29 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 21:32:30.155749 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 600/1167] 10.222.0.43 () {58 vars in 1122 bytes} [Sat Sep 3 21:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 21:32:30.159514 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc510d3e-2e40-402a-9cc6-292fcf273a35 admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:30.162296 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb946f-dafd-4c5e-8ff4-31c7aa4ea634 admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:30.172603 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc510d3e-2e40-402a-9cc6-292fcf273a35 admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:30.173731 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb946f-dafd-4c5e-8ff4-31c7aa4ea634 admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:30.178975 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fada341-dfc0-43bb-ac2d-7d74062a2b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:30.179322 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700281be-4f0e-4a56-bbdc-456dc518230c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:30.179667 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fada341-dfc0-43bb-ac2d-7d74062a2b6f admin admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:30.179974 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fada341-dfc0-43bb-ac2d-7d74062a2b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:30.180146 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700281be-4f0e-4a56-bbdc-456dc518230c admin admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:30.180317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fada341-dfc0-43bb-ac2d-7d74062a2b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:30.180421 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700281be-4f0e-4a56-bbdc-456dc518230c admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:30.180741 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700281be-4f0e-4a56-bbdc-456dc518230c admin admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:30.181382 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fada341-dfc0-43bb-ac2d-7d74062a2b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:30.181500 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700281be-4f0e-4a56-bbdc-456dc518230c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:30.183041 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700281be-4f0e-4a56-bbdc-456dc518230c admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:30.183262 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fada341-dfc0-43bb-ac2d-7d74062a2b6f admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:30.194417 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 601/1168] 10.222.0.43 () {58 vars in 1122 bytes} [Sat Sep 3 21:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 21:32:30.195423 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 568/1169] 10.222.0.43 () {58 vars in 1122 bytes} [Sat Sep 3 21:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 21:32:30.198925 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700281be-4f0e-4a56-bbdc-456dc518230c admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:30.199458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fada341-dfc0-43bb-ac2d-7d74062a2b6f admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:30.210373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fada341-dfc0-43bb-ac2d-7d74062a2b6f admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:30.210598 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700281be-4f0e-4a56-bbdc-456dc518230c admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:30.215144 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29ee88c-2f81-47f1-bb7f-4e17b99e3d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:30.215300 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ad81c-6d23-4a74-82b4-a2147d6e0a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:30.215815 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ad81c-6d23-4a74-82b4-a2147d6e0a8d admin admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:30.215949 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ee88c-2f81-47f1-bb7f-4e17b99e3d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:30.216098 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ad81c-6d23-4a74-82b4-a2147d6e0a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:30.216250 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ee88c-2f81-47f1-bb7f-4e17b99e3d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:30.216357 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ee88c-2f81-47f1-bb7f-4e17b99e3d34 admin admin] PATH_INFO: `/v3/projects/7645ca279eba49e8a352ccb4b0002704/users/92d413a4990944059167ff99ff9289ba/roles/b7001437cbb84adc825e214c44d6e551` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:30.216448 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ad81c-6d23-4a74-82b4-a2147d6e0a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:30.217027 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ad81c-6d23-4a74-82b4-a2147d6e0a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:30.218646 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ad81c-6d23-4a74-82b4-a2147d6e0a8d admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:30.230114 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 569/1170] 10.222.0.43 () {58 vars in 1122 bytes} [Sat Sep 3 21:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 21:32:30.232109 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ee88c-2f81-47f1-bb7f-4e17b99e3d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7645ca279eba49e8a352ccb4b0002704, user_id=92d413a4990944059167ff99ff9289ba, role_id=b7001437cbb84adc825e214c44d6e551)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:30.234411 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ad81c-6d23-4a74-82b4-a2147d6e0a8d admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:30.234932 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29ee88c-2f81-47f1-bb7f-4e17b99e3d34 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:30.246681 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ad81c-6d23-4a74-82b4-a2147d6e0a8d admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:30.251378 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467cba4-9382-4064-8adb-651e0baa4466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:30.252681 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467cba4-9382-4064-8adb-651e0baa4466 admin admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:30.252995 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467cba4-9382-4064-8adb-651e0baa4466 admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:30.253267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467cba4-9382-4064-8adb-651e0baa4466 admin admin] PATH_INFO: `/v3/projects/9eaad2e8728440dfab9eddb6ffcaab88/users/fcd8bf55bab14d58b587d649af660a1b/roles/b7001437cbb84adc825e214c44d6e551` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:30.269642 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467cba4-9382-4064-8adb-651e0baa4466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eaad2e8728440dfab9eddb6ffcaab88, user_id=fcd8bf55bab14d58b587d649af660a1b, role_id=b7001437cbb84adc825e214c44d6e551)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:30.270670 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: WARNING py.warnings [None req-b467cba4-9382-4064-8adb-651e0baa4466 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:32:30.270670 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: warnings.warn(msg) Sep 03 21:32:30.270670 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: Sep 03 21:32:30.274552 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467cba4-9382-4064-8adb-651e0baa4466 admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:30.295487 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 602/1171] 10.222.0.43 () {60 vars in 1483 bytes} [Sat Sep 3 21:32:30 2022] PUT /identity/v3/projects/7645ca279eba49e8a352ccb4b0002704/users/92d413a4990944059167ff99ff9289ba/roles/b7001437cbb84adc825e214c44d6e551 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 21:32:30.301296 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374ed5c-86dd-465b-a576-8b2cf0f4eb57 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:30.304689 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374ed5c-86dd-465b-a576-8b2cf0f4eb57 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:30.304689 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374ed5c-86dd-465b-a576-8b2cf0f4eb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:30.322599 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-6374ed5c-86dd-465b-a576-8b2cf0f4eb57 None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:30.323833 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-6374ed5c-86dd-465b-a576-8b2cf0f4eb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:30.374725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:30.382617 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 570/1172] 10.222.0.43 () {60 vars in 1483 bytes} [Sat Sep 3 21:32:30 2022] PUT /identity/v3/projects/9eaad2e8728440dfab9eddb6ffcaab88/users/fcd8bf55bab14d58b587d649af660a1b/roles/b7001437cbb84adc825e214c44d6e551 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 21:32:30.387606 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 603/1173] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:32:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 21:32:30.387765 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97650bf1-0a45-4cd0-bcc5-1cf05ca0f92f None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:30.387963 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97650bf1-0a45-4cd0-bcc5-1cf05ca0f92f None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:30.388198 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97650bf1-0a45-4cd0-bcc5-1cf05ca0f92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:30.398853 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374ed5c-86dd-465b-a576-8b2cf0f4eb57 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:30.409886 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-97650bf1-0a45-4cd0-bcc5-1cf05ca0f92f None None] MFA Rules not processed for user `3e2bd2fbe30f4ddbb48bb8150f222665`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:30.411093 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-97650bf1-0a45-4cd0-bcc5-1cf05ca0f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:30.461675 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:30.467856 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374ed5c-86dd-465b-a576-8b2cf0f4eb57 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:30.474378 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 571/1174] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:32:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:32:30.485149 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97650bf1-0a45-4cd0-bcc5-1cf05ca0f92f None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:30.546967 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211755b-9bd7-42b8-b0b5-b0c749609586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:30.547618 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211755b-9bd7-42b8-b0b5-b0c749609586 service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:30.547881 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211755b-9bd7-42b8-b0b5-b0c749609586 service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:30.548146 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211755b-9bd7-42b8-b0b5-b0c749609586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:30.555978 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97650bf1-0a45-4cd0-bcc5-1cf05ca0f92f None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:30.559908 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211755b-9bd7-42b8-b0b5-b0c749609586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:30.561317 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f423956-02b7-4b30-a381-ebd8debc94ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:30.561475 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211755b-9bd7-42b8-b0b5-b0c749609586 service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:30.562288 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f423956-02b7-4b30-a381-ebd8debc94ba service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:30.562781 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f423956-02b7-4b30-a381-ebd8debc94ba service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:30.563248 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f423956-02b7-4b30-a381-ebd8debc94ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:30.572557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 604/1175] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:32:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 21:32:30.574860 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f423956-02b7-4b30-a381-ebd8debc94ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:30.576299 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f423956-02b7-4b30-a381-ebd8debc94ba service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:30.587359 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 572/1176] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:32:30 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 21:32:37.313773 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b13aaf-ece5-4fad-9a1b-44a75aa5571e None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:37.315257 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b13aaf-ece5-4fad-9a1b-44a75aa5571e None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:37.315257 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b13aaf-ece5-4fad-9a1b-44a75aa5571e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:37.362358 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-97b13aaf-ece5-4fad-9a1b-44a75aa5571e None None] MFA Rules not processed for user `fcd8bf55bab14d58b587d649af660a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:37.363705 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-97b13aaf-ece5-4fad-9a1b-44a75aa5571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:37.519350 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 605/1177] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:32:37 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:32:37.520108 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f423956-02b7-4b30-a381-ebd8debc94ba service neutron] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:37.533997 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f423956-02b7-4b30-a381-ebd8debc94ba service neutron] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:37.552054 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cd28e-a534-4c38-a1bd-f08dee88af83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:37.553029 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cd28e-a534-4c38-a1bd-f08dee88af83 admin admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:37.553029 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cd28e-a534-4c38-a1bd-f08dee88af83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:37.553249 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cd28e-a534-4c38-a1bd-f08dee88af83 admin admin] PATH_INFO: `/v3/projects` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:37.553898 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cd28e-a534-4c38-a1bd-f08dee88af83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:37.559724 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cd28e-a534-4c38-a1bd-f08dee88af83 admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:37.650587 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec1c7-8021-4f54-a0fc-70087517655d None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:37.650878 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec1c7-8021-4f54-a0fc-70087517655d None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:37.651335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ec1c7-8021-4f54-a0fc-70087517655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:37.654130 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 573/1178] 10.222.0.43 () {60 vars in 1153 bytes} [Sat Sep 3 21:32:37 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 21:32:37.660745 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cd28e-a534-4c38-a1bd-f08dee88af83 admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:37.688961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-564ec1c7-8021-4f54-a0fc-70087517655d None None] MFA Rules not processed for user `92d413a4990944059167ff99ff9289ba`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:37.692691 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-564ec1c7-8021-4f54-a0fc-70087517655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:37.746737 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:37.758984 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cd28e-a534-4c38-a1bd-f08dee88af83 admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:37.770018 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a9ff5-3c23-4e20-8560-25712f3a3e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:37.771101 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a9ff5-3c23-4e20-8560-25712f3a3e7f admin admin] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:37.771800 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a9ff5-3c23-4e20-8560-25712f3a3e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:37.772486 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a9ff5-3c23-4e20-8560-25712f3a3e7f admin admin] PATH_INFO: `/v3/users` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:37.773399 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a9ff5-3c23-4e20-8560-25712f3a3e7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:37.775637 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a9ff5-3c23-4e20-8560-25712f3a3e7f admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:37.799036 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 606/1179] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:32:37 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:32:37.803647 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec1c7-8021-4f54-a0fc-70087517655d None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:37.817690 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ec1c7-8021-4f54-a0fc-70087517655d None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:37.822493 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de5f6f-c81d-4625-b090-dbd2274a6d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:37.823121 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de5f6f-c81d-4625-b090-dbd2274a6d95 admin admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:37.823402 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de5f6f-c81d-4625-b090-dbd2274a6d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:37.823675 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de5f6f-c81d-4625-b090-dbd2274a6d95 admin admin] PATH_INFO: `/v3/projects` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:37.824319 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de5f6f-c81d-4625-b090-dbd2274a6d95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:37.826334 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de5f6f-c81d-4625-b090-dbd2274a6d95 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:37.897458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 574/1180] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Sep 3 21:32:37 2022] POST /identity/v3/users => generated 295 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 21:32:37.901376 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a9ff5-3c23-4e20-8560-25712f3a3e7f admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:37.912674 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a9ff5-3c23-4e20-8560-25712f3a3e7f admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:37.917935 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec89956-ad32-44ff-bd7e-27d66011ba4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:37.918620 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec89956-ad32-44ff-bd7e-27d66011ba4d admin admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:37.919058 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec89956-ad32-44ff-bd7e-27d66011ba4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:37.919432 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec89956-ad32-44ff-bd7e-27d66011ba4d admin admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:37.920048 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec89956-ad32-44ff-bd7e-27d66011ba4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:37.926223 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec89956-ad32-44ff-bd7e-27d66011ba4d admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:37.926319 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 607/1181] 10.222.0.43 () {60 vars in 1153 bytes} [Sat Sep 3 21:32:37 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 03 21:32:37.928762 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de5f6f-c81d-4625-b090-dbd2274a6d95 admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:37.948942 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 575/1182] 10.222.0.43 () {58 vars in 1122 bytes} [Sat Sep 3 21:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 03 21:32:37.953273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec89956-ad32-44ff-bd7e-27d66011ba4d admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:37.971848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec89956-ad32-44ff-bd7e-27d66011ba4d admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:38.036757 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de5f6f-c81d-4625-b090-dbd2274a6d95 admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:38.041766 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86ae1d-582f-4e5e-9fb5-2dfe2e480d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:38.041948 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:38.042390 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86ae1d-582f-4e5e-9fb5-2dfe2e480d6a admin admin] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:38.042757 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86ae1d-582f-4e5e-9fb5-2dfe2e480d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:38.042945 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86ae1d-582f-4e5e-9fb5-2dfe2e480d6a admin admin] PATH_INFO: `/v3/users` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:38.043577 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86ae1d-582f-4e5e-9fb5-2dfe2e480d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:38.045700 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86ae1d-582f-4e5e-9fb5-2dfe2e480d6a admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:38.049351 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0c071-9c92-4212-876e-d49fb63cec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:38.051872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0c071-9c92-4212-876e-d49fb63cec2e admin admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:38.051872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0c071-9c92-4212-876e-d49fb63cec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:38.051872 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0c071-9c92-4212-876e-d49fb63cec2e admin admin] PATH_INFO: `/v3/projects/55be2ed8a4e6475f830eb0aaf2b9e35c/users/ed278e32234947068a4477e4c4cabec7/roles/a1c22a1558c34c1d9d262bf1da31887e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:38.070267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0c071-9c92-4212-876e-d49fb63cec2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=55be2ed8a4e6475f830eb0aaf2b9e35c, user_id=ed278e32234947068a4477e4c4cabec7, role_id=a1c22a1558c34c1d9d262bf1da31887e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:38.073048 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0c071-9c92-4212-876e-d49fb63cec2e admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:38.147471 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 608/1183] 10.222.0.43 () {60 vars in 1144 bytes} [Sat Sep 3 21:32:37 2022] POST /identity/v3/users => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 03 21:32:38.148576 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86ae1d-582f-4e5e-9fb5-2dfe2e480d6a admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:38.159200 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86ae1d-582f-4e5e-9fb5-2dfe2e480d6a admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:38.164380 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225914f-8709-4015-8d78-45fc25783689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:38.165581 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225914f-8709-4015-8d78-45fc25783689 admin admin] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:38.165581 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225914f-8709-4015-8d78-45fc25783689 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:38.165581 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225914f-8709-4015-8d78-45fc25783689 admin admin] PATH_INFO: `/v3/roles` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:38.170017 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225914f-8709-4015-8d78-45fc25783689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:38.170017 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225914f-8709-4015-8d78-45fc25783689 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:38.173341 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 576/1184] 10.222.0.43 () {60 vars in 1483 bytes} [Sat Sep 3 21:32:37 2022] PUT /identity/v3/projects/55be2ed8a4e6475f830eb0aaf2b9e35c/users/ed278e32234947068a4477e4c4cabec7/roles/a1c22a1558c34c1d9d262bf1da31887e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 21:32:38.177629 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0c071-9c92-4212-876e-d49fb63cec2e admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:38.183249 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 609/1185] 10.222.0.43 () {58 vars in 1122 bytes} [Sat Sep 3 21:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 21:32:38.189936 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225914f-8709-4015-8d78-45fc25783689 admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:38.233767 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225914f-8709-4015-8d78-45fc25783689 admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:38.264369 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0c071-9c92-4212-876e-d49fb63cec2e admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:38.271282 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011da23-95a2-47d4-a3ee-1f30df0e769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:38.271953 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011da23-95a2-47d4-a3ee-1f30df0e769c admin admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:38.272232 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011da23-95a2-47d4-a3ee-1f30df0e769c admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:38.272506 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011da23-95a2-47d4-a3ee-1f30df0e769c admin admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:38.273200 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011da23-95a2-47d4-a3ee-1f30df0e769c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:38.279401 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011da23-95a2-47d4-a3ee-1f30df0e769c admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:38.292911 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 577/1186] 10.222.0.43 () {58 vars in 1122 bytes} [Sat Sep 3 21:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 21:32:38.296679 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011da23-95a2-47d4-a3ee-1f30df0e769c admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:38.309612 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011da23-95a2-47d4-a3ee-1f30df0e769c admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:38.316470 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dda342-8994-43d2-8e6e-64c7058f89b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:38.317189 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dda342-8994-43d2-8e6e-64c7058f89b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:38.317472 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dda342-8994-43d2-8e6e-64c7058f89b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:38.317747 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dda342-8994-43d2-8e6e-64c7058f89b4 admin admin] PATH_INFO: `/v3/projects/55be2ed8a4e6475f830eb0aaf2b9e35c/users/ed278e32234947068a4477e4c4cabec7/roles/a1c22a1558c34c1d9d262bf1da31887e` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:38.319262 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6509f-4889-45dc-ba6f-7d15b1ee96d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:38.319821 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dda342-8994-43d2-8e6e-64c7058f89b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55be2ed8a4e6475f830eb0aaf2b9e35c, user_id=ed278e32234947068a4477e4c4cabec7, role_id=a1c22a1558c34c1d9d262bf1da31887e)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:38.320077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6509f-4889-45dc-ba6f-7d15b1ee96d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:38.320428 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6509f-4889-45dc-ba6f-7d15b1ee96d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:38.320826 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6509f-4889-45dc-ba6f-7d15b1ee96d6 admin admin] PATH_INFO: `/v3/projects/de6d0a2afc48417f9183673683bccc40/users/b9dd9fcc4bb84a4693de2d2a1e304af7/roles/a1c22a1558c34c1d9d262bf1da31887e` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:38.323866 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dda342-8994-43d2-8e6e-64c7058f89b4 admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:38.338293 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 578/1187] 10.222.0.43 () {60 vars in 1483 bytes} [Sat Sep 3 21:32:38 2022] PUT /identity/v3/projects/55be2ed8a4e6475f830eb0aaf2b9e35c/users/ed278e32234947068a4477e4c4cabec7/roles/a1c22a1558c34c1d9d262bf1da31887e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 03 21:32:38.346330 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6509f-4889-45dc-ba6f-7d15b1ee96d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6d0a2afc48417f9183673683bccc40, user_id=b9dd9fcc4bb84a4693de2d2a1e304af7, role_id=a1c22a1558c34c1d9d262bf1da31887e)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:38.349822 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6509f-4889-45dc-ba6f-7d15b1ee96d6 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:38.487872 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 610/1188] 10.222.0.43 () {60 vars in 1483 bytes} [Sat Sep 3 21:32:38 2022] PUT /identity/v3/projects/de6d0a2afc48417f9183673683bccc40/users/b9dd9fcc4bb84a4693de2d2a1e304af7/roles/a1c22a1558c34c1d9d262bf1da31887e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:32:38.492378 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dda342-8994-43d2-8e6e-64c7058f89b4 admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:38.579580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dda342-8994-43d2-8e6e-64c7058f89b4 admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:38.683422 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3043aa-cd15-43e5-b10c-d700a311d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:38.684127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3043aa-cd15-43e5-b10c-d700a311d99e admin admin] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:38.684485 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3043aa-cd15-43e5-b10c-d700a311d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:38.684810 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3043aa-cd15-43e5-b10c-d700a311d99e admin admin] PATH_INFO: `/v3/roles` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:38.685457 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3043aa-cd15-43e5-b10c-d700a311d99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:38.687097 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3043aa-cd15-43e5-b10c-d700a311d99e admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:38.699662 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 579/1189] 10.222.0.43 () {58 vars in 1122 bytes} [Sat Sep 3 21:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 03 21:32:38.703985 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6509f-4889-45dc-ba6f-7d15b1ee96d6 admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:38.716109 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6509f-4889-45dc-ba6f-7d15b1ee96d6 admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:38.722191 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3ad77-ab12-423d-b077-d7e9ac7ad6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:38.723234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ad77-ab12-423d-b077-d7e9ac7ad6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:38.723495 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ad77-ab12-423d-b077-d7e9ac7ad6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:38.723949 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ad77-ab12-423d-b077-d7e9ac7ad6c6 admin admin] PATH_INFO: `/v3/projects/de6d0a2afc48417f9183673683bccc40/users/b9dd9fcc4bb84a4693de2d2a1e304af7/roles/a1c22a1558c34c1d9d262bf1da31887e` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:38.726140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3ad77-ab12-423d-b077-d7e9ac7ad6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6d0a2afc48417f9183673683bccc40, user_id=b9dd9fcc4bb84a4693de2d2a1e304af7, role_id=a1c22a1558c34c1d9d262bf1da31887e)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:38.735500 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3ad77-ab12-423d-b077-d7e9ac7ad6c6 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:38.739439 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:38.745077 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 611/1190] 10.222.0.43 () {60 vars in 1483 bytes} [Sat Sep 3 21:32:38 2022] PUT /identity/v3/projects/de6d0a2afc48417f9183673683bccc40/users/b9dd9fcc4bb84a4693de2d2a1e304af7/roles/a1c22a1558c34c1d9d262bf1da31887e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:32:46.734322 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132bfb7-92f4-4480-9df1-484ff9a696f0 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:46.734848 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132bfb7-92f4-4480-9df1-484ff9a696f0 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:46.734942 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132bfb7-92f4-4480-9df1-484ff9a696f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:46.745988 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:46.762582 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25066a-a55e-47c9-b5be-6774e786b834 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:46.763671 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25066a-a55e-47c9-b5be-6774e786b834 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:46.763671 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25066a-a55e-47c9-b5be-6774e786b834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:46.778390 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-d132bfb7-92f4-4480-9df1-484ff9a696f0 None None] MFA Rules not processed for user `ed278e32234947068a4477e4c4cabec7`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:46.779894 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-d132bfb7-92f4-4480-9df1-484ff9a696f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:46.797960 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-6b25066a-a55e-47c9-b5be-6774e786b834 None None] MFA Rules not processed for user `b9dd9fcc4bb84a4693de2d2a1e304af7`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:46.799378 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-6b25066a-a55e-47c9-b5be-6774e786b834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:46.870267 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 580/1191] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:32:46 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:32:46.884053 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 612/1192] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:32:46 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:32:46.885305 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132bfb7-92f4-4480-9df1-484ff9a696f0 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:46.888691 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-d132bfb7-92f4-4480-9df1-484ff9a696f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:46.897212 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25066a-a55e-47c9-b5be-6774e786b834 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:46.899449 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-6b25066a-a55e-47c9-b5be-6774e786b834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:46.969774 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132bfb7-92f4-4480-9df1-484ff9a696f0 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:46.971590 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25066a-a55e-47c9-b5be-6774e786b834 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:46.974832 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1cc1f-d3c3-4ecc-92c7-de5ca9fbb882 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05e9121d1bc48d497410de13a07b198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:46.975294 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa8f41-ac59-4bfb-9a74-74ee0b4ca8b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05e9121d1bc48d497410de13a07b198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:46.975456 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1cc1f-d3c3-4ecc-92c7-de5ca9fbb882 service glance] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:46.975739 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1cc1f-d3c3-4ecc-92c7-de5ca9fbb882 service glance] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:46.975911 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa8f41-ac59-4bfb-9a74-74ee0b4ca8b6 service glance] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:46.976168 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa8f41-ac59-4bfb-9a74-74ee0b4ca8b6 service glance] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:46.976440 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa8f41-ac59-4bfb-9a74-74ee0b4ca8b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:46.976715 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1cc1f-d3c3-4ecc-92c7-de5ca9fbb882 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:47.049835 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa8f41-ac59-4bfb-9a74-74ee0b4ca8b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:47.051821 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa8f41-ac59-4bfb-9a74-74ee0b4ca8b6 service glance] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:47.058433 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1cc1f-d3c3-4ecc-92c7-de5ca9fbb882 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:47.060989 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1cc1f-d3c3-4ecc-92c7-de5ca9fbb882 service glance] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:47.067332 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 613/1193] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:32:46 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 21:32:47.074549 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 581/1194] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:32:46 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:32:56.716162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c4bf-a43f-40d4-b6a2-1b88373444e5 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:56.716743 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c4bf-a43f-40d4-b6a2-1b88373444e5 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:56.716743 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c4bf-a43f-40d4-b6a2-1b88373444e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:56.740387 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-3da2c4bf-a43f-40d4-b6a2-1b88373444e5 None None] MFA Rules not processed for user `92d413a4990944059167ff99ff9289ba`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:56.741638 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-3da2c4bf-a43f-40d4-b6a2-1b88373444e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:56.749690 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 614/1195] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:32:56 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:32:57.055111 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588c5dc-de3e-4e72-b820-bba227c53c2e None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:57.055548 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588c5dc-de3e-4e72-b820-bba227c53c2e None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:57.055705 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588c5dc-de3e-4e72-b820-bba227c53c2e None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:57.057638 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 582/1196] 10.222.0.43 () {54 vars in 962 bytes} [Sat Sep 3 21:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:32:57.063241 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06907-605c-4c80-839a-72f2e8a5e90c None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:57.063691 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06907-605c-4c80-839a-72f2e8a5e90c None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:57.064291 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06907-605c-4c80-839a-72f2e8a5e90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:57.068784 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=80 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:57.093058 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-41a06907-605c-4c80-839a-72f2e8a5e90c None None] MFA Rules not processed for user `7d95ba5e28764ed49d1142fecb16adab`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:57.095841 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-41a06907-605c-4c80-839a-72f2e8a5e90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:57.133433 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=100 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:32:57.179964 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 615/1197] 10.222.0.43 () {58 vars in 1059 bytes} [Sat Sep 3 21:32:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:32:57.185899 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281413-191c-4682-9570-04602ee0b483 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:57.186184 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281413-191c-4682-9570-04602ee0b483 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:57.186460 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281413-191c-4682-9570-04602ee0b483 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:57.187799 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 583/1198] 10.222.0.43 () {54 vars in 912 bytes} [Sat Sep 3 21:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:32:57.193713 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b33e7e-d43a-48bc-931a-a79fc5423ccc None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:57.194415 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b33e7e-d43a-48bc-931a-a79fc5423ccc None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:57.194688 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b33e7e-d43a-48bc-931a-a79fc5423ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:57.216014 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-68b33e7e-d43a-48bc-931a-a79fc5423ccc None None] MFA Rules not processed for user `7d95ba5e28764ed49d1142fecb16adab`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:57.217331 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-68b33e7e-d43a-48bc-931a-a79fc5423ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:57.227205 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 616/1199] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Sep 3 21:32:57 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:32:57.239657 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e281413-191c-4682-9570-04602ee0b483 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:57.251332 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e281413-191c-4682-9570-04602ee0b483 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:57.256083 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ea08a-72a2-4aed-bea5-80ea109724cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c05e9121d1bc48d497410de13a07b198', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:57.256734 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ea08a-72a2-4aed-bea5-80ea109724cb service glance] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:57.257018 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ea08a-72a2-4aed-bea5-80ea109724cb service glance] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:57.257295 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ea08a-72a2-4aed-bea5-80ea109724cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:57.268909 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ea08a-72a2-4aed-bea5-80ea109724cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:57.270958 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ea08a-72a2-4aed-bea5-80ea109724cb service glance] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:57.284221 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 584/1200] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:32:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:32:57.650743 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b246-5042-43bb-bd81-2baa6e3c84ea None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:57.651034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b246-5042-43bb-bd81-2baa6e3c84ea None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:57.651316 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b246-5042-43bb-bd81-2baa6e3c84ea None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:57.652705 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 617/1201] 10.222.0.43 () {54 vars in 912 bytes} [Sat Sep 3 21:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:32:57.659273 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a36ef-4794-4a5d-b4ae-e838b6a6eed5 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:57.659875 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a36ef-4794-4a5d-b4ae-e838b6a6eed5 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:57.660127 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a36ef-4794-4a5d-b4ae-e838b6a6eed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:57.686188 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-431a36ef-4794-4a5d-b4ae-e838b6a6eed5 None None] MFA Rules not processed for user `a969a77183c34a7e9eff28636b1170c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:57.687440 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-431a36ef-4794-4a5d-b4ae-e838b6a6eed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:57.742405 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 585/1202] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Sep 3 21:32:57 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:32:57.754248 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b246-5042-43bb-bd81-2baa6e3c84ea None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:57.766094 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b246-5042-43bb-bd81-2baa6e3c84ea None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:57.769850 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27220142-a324-4feb-9c6a-e773515efd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:57.770386 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27220142-a324-4feb-9c6a-e773515efd72 service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:57.770665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27220142-a324-4feb-9c6a-e773515efd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:57.770934 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27220142-a324-4feb-9c6a-e773515efd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:57.778033 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27220142-a324-4feb-9c6a-e773515efd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:57.779456 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27220142-a324-4feb-9c6a-e773515efd72 service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:57.788429 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 618/1203] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:32:57 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:32:58.268573 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f821b-ec1c-4e2a-a526-9fa567d176fd None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:58.269167 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f821b-ec1c-4e2a-a526-9fa567d176fd None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:58.269275 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f821b-ec1c-4e2a-a526-9fa567d176fd None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:58.270600 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 586/1204] 10.222.0.43 () {54 vars in 962 bytes} [Sat Sep 3 21:32:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:32:58.276629 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eadfe1-8c32-47e0-bea9-d6bff96bc2f1 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:58.276920 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eadfe1-8c32-47e0-bea9-d6bff96bc2f1 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:58.277198 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eadfe1-8c32-47e0-bea9-d6bff96bc2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:58.296034 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f821b-ec1c-4e2a-a526-9fa567d176fd None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:58.300788 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-82eadfe1-8c32-47e0-bea9-d6bff96bc2f1 None None] MFA Rules not processed for user `7d95ba5e28764ed49d1142fecb16adab`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:58.302428 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-82eadfe1-8c32-47e0-bea9-d6bff96bc2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:58.313678 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 619/1205] 10.222.0.43 () {58 vars in 1059 bytes} [Sat Sep 3 21:32:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 21:32:58.319840 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cf29d-dd5f-412e-9734-9a0c08f77f19 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:58.320124 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cf29d-dd5f-412e-9734-9a0c08f77f19 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:58.320399 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cf29d-dd5f-412e-9734-9a0c08f77f19 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:58.322143 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 620/1206] 10.222.0.43 () {54 vars in 912 bytes} [Sat Sep 3 21:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:32:58.328334 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e7e49-5c6a-4172-b9fc-4be7066eb707 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:58.328749 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e7e49-5c6a-4172-b9fc-4be7066eb707 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:58.329034 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e7e49-5c6a-4172-b9fc-4be7066eb707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:58.352734 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-8d1e7e49-5c6a-4172-b9fc-4be7066eb707 None None] MFA Rules not processed for user `7d95ba5e28764ed49d1142fecb16adab`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:32:58.355107 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-8d1e7e49-5c6a-4172-b9fc-4be7066eb707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:58.364275 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 621/1207] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Sep 3 21:32:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 03 21:32:58.375755 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e7e49-5c6a-4172-b9fc-4be7066eb707 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:32:58.386515 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e7e49-5c6a-4172-b9fc-4be7066eb707 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:58.390892 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed238ee-de52-4b61-9d95-ca7a2a08a82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:58.392787 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed238ee-de52-4b61-9d95-ca7a2a08a82b service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:58.392787 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed238ee-de52-4b61-9d95-ca7a2a08a82b service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:58.393058 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed238ee-de52-4b61-9d95-ca7a2a08a82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:58.397807 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f821b-ec1c-4e2a-a526-9fa567d176fd None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:32:58.403671 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed238ee-de52-4b61-9d95-ca7a2a08a82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:58.405174 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed238ee-de52-4b61-9d95-ca7a2a08a82b service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:58.405464 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42cdd5-0c67-4e79-b3e6-a23d62b5db55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb45f9358b64974a39d996e93e5c105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:32:58.406629 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42cdd5-0c67-4e79-b3e6-a23d62b5db55 service placement] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:32:58.406979 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42cdd5-0c67-4e79-b3e6-a23d62b5db55 service placement] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:32:58.407318 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42cdd5-0c67-4e79-b3e6-a23d62b5db55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:32:58.409535 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-db42cdd5-0c67-4e79-b3e6-a23d62b5db55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:32:58.418413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 622/1208] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:32:58 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 21:32:58.428501 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42cdd5-0c67-4e79-b3e6-a23d62b5db55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:32:58.430247 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42cdd5-0c67-4e79-b3e6-a23d62b5db55 service placement] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:32:58.442376 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 587/1209] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:32:58 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 21:33:08.412116 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=35 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:33:08.437506 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=61 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:33:12.762708 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49165-2c62-4633-acde-a29840f9d69f None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:33:12.763594 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49165-2c62-4633-acde-a29840f9d69f None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:33:12.763594 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc49165-2c62-4633-acde-a29840f9d69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:33:12.785353 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-8dc49165-2c62-4633-acde-a29840f9d69f None None] MFA Rules not processed for user `a969a77183c34a7e9eff28636b1170c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:33:12.786610 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-8dc49165-2c62-4633-acde-a29840f9d69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:33:12.794846 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 623/1210] 10.222.0.45 () {58 vars in 1015 bytes} [Sat Sep 3 21:33:12 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:33:12.814613 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42cdd5-0c67-4e79-b3e6-a23d62b5db55 service placement] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:33:12.824985 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42cdd5-0c67-4e79-b3e6-a23d62b5db55 service placement] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:33:12.829576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507528ff-d39c-482b-85d6-27aeeb743d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:33:12.834907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507528ff-d39c-482b-85d6-27aeeb743d5b service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:33:12.834907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507528ff-d39c-482b-85d6-27aeeb743d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:33:12.834907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507528ff-d39c-482b-85d6-27aeeb743d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:33:12.839147 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507528ff-d39c-482b-85d6-27aeeb743d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:33:12.840637 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507528ff-d39c-482b-85d6-27aeeb743d5b service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:33:12.850501 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 588/1211] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:33:12 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:33:13.748144 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db3323-183d-43c3-979d-6399b452c587 None None] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:33:13.748509 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db3323-183d-43c3-979d-6399b452c587 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:33:13.748755 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db3323-183d-43c3-979d-6399b452c587 None None] PATH_INFO: `/` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:33:13.750489 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 624/1212] 10.222.0.43 () {54 vars in 921 bytes} [Sat Sep 3 21:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:33:13.758903 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dd509-ec2c-4570-be1c-a67424bcdda9 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:33:13.759507 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dd509-ec2c-4570-be1c-a67424bcdda9 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:33:13.760484 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dd509-ec2c-4570-be1c-a67424bcdda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:33:13.795547 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-6d0dd509-ec2c-4570-be1c-a67424bcdda9 None None] MFA Rules not processed for user `7d95ba5e28764ed49d1142fecb16adab`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:33:13.796962 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-6d0dd509-ec2c-4570-be1c-a67424bcdda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:33:13.809042 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 589/1213] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Sep 3 21:33:13 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:33:13.846952 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db3323-183d-43c3-979d-6399b452c587 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:33:13.862020 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db3323-183d-43c3-979d-6399b452c587 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:33:13.867893 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c9267-0e86-46fd-b35a-d7fa38d83387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:33:13.868492 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c9267-0e86-46fd-b35a-d7fa38d83387 service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:33:13.868813 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c9267-0e86-46fd-b35a-d7fa38d83387 service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:33:13.869091 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c9267-0e86-46fd-b35a-d7fa38d83387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:33:13.878887 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c9267-0e86-46fd-b35a-d7fa38d83387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:33:13.880517 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c9267-0e86-46fd-b35a-d7fa38d83387 service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:33:13.892000 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 625/1214] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:33:13 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:33:20.180225 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28510d-0e9e-4e75-9c34-bf1ee1377787 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:33:20.180225 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28510d-0e9e-4e75-9c34-bf1ee1377787 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:33:20.180225 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e28510d-0e9e-4e75-9c34-bf1ee1377787 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:33:20.180225 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 590/1215] 10.222.0.43 () {54 vars in 921 bytes} [Sat Sep 3 21:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:33:20.185978 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc5373-425a-4f21-a7b0-c5d82af5ca95 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:33:20.186557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc5373-425a-4f21-a7b0-c5d82af5ca95 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:33:20.186557 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc5373-425a-4f21-a7b0-c5d82af5ca95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:33:20.208114 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-edfc5373-425a-4f21-a7b0-c5d82af5ca95 None None] MFA Rules not processed for user `7d95ba5e28764ed49d1142fecb16adab`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:33:20.209521 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-edfc5373-425a-4f21-a7b0-c5d82af5ca95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:33:20.220100 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 626/1216] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Sep 3 21:33:20 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:33:20.234640 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28510d-0e9e-4e75-9c34-bf1ee1377787 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:33:20.255352 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e28510d-0e9e-4e75-9c34-bf1ee1377787 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:33:20.261672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26215ced-cca2-46e0-bb59-5cf023640ae4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:33:20.262270 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215ced-cca2-46e0-bb59-5cf023640ae4 service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:33:20.262549 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215ced-cca2-46e0-bb59-5cf023640ae4 service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:33:20.262819 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26215ced-cca2-46e0-bb59-5cf023640ae4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:33:20.272031 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26215ced-cca2-46e0-bb59-5cf023640ae4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:33:20.274788 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26215ced-cca2-46e0-bb59-5cf023640ae4 service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:33:20.287960 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 591/1217] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:33:20 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:33:30.202480 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=12 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:33:30.282863 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=15 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:33:38.426016 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc5373-425a-4f21-a7b0-c5d82af5ca95 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:33:38.436520 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc5373-425a-4f21-a7b0-c5d82af5ca95 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:33:38.440102 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3893e-0408-460d-a804-346bd39df5e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:33:38.440776 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3893e-0408-460d-a804-346bd39df5e0 service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:33:38.441059 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3893e-0408-460d-a804-346bd39df5e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:33:38.441330 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3893e-0408-460d-a804-346bd39df5e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:33:38.452638 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3893e-0408-460d-a804-346bd39df5e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:33:38.454496 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3893e-0408-460d-a804-346bd39df5e0 service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:33:38.465057 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 627/1218] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:33:38 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:33:48.461447 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=6 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:34:54.150967 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f2472-71bd-44e3-a6a2-8d49ccaca067 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:34:54.151519 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f2472-71bd-44e3-a6a2-8d49ccaca067 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:34:54.151519 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f2472-71bd-44e3-a6a2-8d49ccaca067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:34:54.181232 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-528f2472-71bd-44e3-a6a2-8d49ccaca067 None None] MFA Rules not processed for user `fcd8bf55bab14d58b587d649af660a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:34:54.182444 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-528f2472-71bd-44e3-a6a2-8d49ccaca067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:34:54.209669 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 592/1219] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:34:54 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:34:54.572980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9939b-a540-4e85-822b-ae7c895891bf None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:34:54.573475 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9939b-a540-4e85-822b-ae7c895891bf None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:34:54.573558 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9939b-a540-4e85-822b-ae7c895891bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:34:54.650060 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-9bb9939b-a540-4e85-822b-ae7c895891bf None None] MFA Rules not processed for user `a969a77183c34a7e9eff28636b1170c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:34:54.651257 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-9bb9939b-a540-4e85-822b-ae7c895891bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:34:54.685980 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 628/1220] 10.222.0.43 () {58 vars in 1009 bytes} [Sat Sep 3 21:34:54 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:34:54.699050 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f2472-71bd-44e3-a6a2-8d49ccaca067 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:34:54.709116 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f2472-71bd-44e3-a6a2-8d49ccaca067 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:34:54.712621 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576cbee-ba44-428d-b5d8-58900236f768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:34:54.713253 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576cbee-ba44-428d-b5d8-58900236f768 service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:34:54.713534 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576cbee-ba44-428d-b5d8-58900236f768 service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:34:54.713810 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576cbee-ba44-428d-b5d8-58900236f768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:34:54.721672 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576cbee-ba44-428d-b5d8-58900236f768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:34:54.723053 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576cbee-ba44-428d-b5d8-58900236f768 service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:34:54.730989 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 593/1221] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:34:54 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:35:04.683169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=33 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:35:04.727660 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=21 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:35:34.585957 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc659-91b0-4438-84d2-06e0738188ff None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:35:34.588311 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc659-91b0-4438-84d2-06e0738188ff None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:35:34.588311 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39dc659-91b0-4438-84d2-06e0738188ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:35:34.605907 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-c39dc659-91b0-4438-84d2-06e0738188ff None None] MFA Rules not processed for user `fcd8bf55bab14d58b587d649af660a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:35:34.607222 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-c39dc659-91b0-4438-84d2-06e0738188ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:35:34.614186 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 629/1222] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:35:34 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:35:44.600029 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=3 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:35:53.833013 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d0823-dc73-4608-aa8b-841ba11ed7f1 None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:35:53.833535 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d0823-dc73-4608-aa8b-841ba11ed7f1 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:35:53.833622 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d0823-dc73-4608-aa8b-841ba11ed7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:35:53.853320 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-cf7d0823-dc73-4608-aa8b-841ba11ed7f1 None None] MFA Rules not processed for user `fcd8bf55bab14d58b587d649af660a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:35:53.854512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-cf7d0823-dc73-4608-aa8b-841ba11ed7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:35:53.861285 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 594/1223] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:35:53 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:35:56.399368 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dc659-91b0-4438-84d2-06e0738188ff None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:35:56.428704 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39dc659-91b0-4438-84d2-06e0738188ff None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:35:56.434410 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22d420-86a9-4e4e-8981-4ba060f14582 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb45f9358b64974a39d996e93e5c105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:35:56.435036 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d420-86a9-4e4e-8981-4ba060f14582 service placement] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:35:56.435299 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d420-86a9-4e4e-8981-4ba060f14582 service placement] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:35:56.435571 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d420-86a9-4e4e-8981-4ba060f14582 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:35:56.444322 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22d420-86a9-4e4e-8981-4ba060f14582 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:35:56.446009 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22d420-86a9-4e4e-8981-4ba060f14582 service placement] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:35:56.461172 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 630/1224] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:35:56 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:36:03.847761 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=3 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:36:06.456883 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=13 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:09.937758 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9e194-96b8-4ba7-aac0-627fc6c3208b None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:37:09.938206 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9e194-96b8-4ba7-aac0-627fc6c3208b None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:37:09.938587 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9e194-96b8-4ba7-aac0-627fc6c3208b None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:37:09.940637 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 595/1225] 10.222.0.43 () {54 vars in 921 bytes} [Sat Sep 3 21:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 03 21:37:09.947202 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5d75e-bb79-4cdc-93c0-2db5262569fe None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:37:09.947651 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5d75e-bb79-4cdc-93c0-2db5262569fe None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:37:09.947942 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5d75e-bb79-4cdc-93c0-2db5262569fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:37:10.019716 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-71b5d75e-bb79-4cdc-93c0-2db5262569fe None None] MFA Rules not processed for user `7d95ba5e28764ed49d1142fecb16adab`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:37:10.021121 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-71b5d75e-bb79-4cdc-93c0-2db5262569fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:37:10.042952 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 631/1226] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Sep 3 21:37:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:37:10.057974 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9e194-96b8-4ba7-aac0-627fc6c3208b None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:37:10.083100 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9e194-96b8-4ba7-aac0-627fc6c3208b None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:37:10.092518 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acd79d1-c7ee-4f52-be3e-b3e767e6faad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:37:10.093502 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd79d1-c7ee-4f52-be3e-b3e767e6faad service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:37:10.094899 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd79d1-c7ee-4f52-be3e-b3e767e6faad service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:37:10.095524 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acd79d1-c7ee-4f52-be3e-b3e767e6faad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:37:10.108310 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd79d1-c7ee-4f52-be3e-b3e767e6faad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:37:10.111196 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acd79d1-c7ee-4f52-be3e-b3e767e6faad service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:37:10.126019 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 596/1227] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:37:10 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:37:18.713683 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4386d4b-3146-4525-94f6-4b91f06126c7 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:37:18.714227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4386d4b-3146-4525-94f6-4b91f06126c7 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:37:18.714227 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4386d4b-3146-4525-94f6-4b91f06126c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:37:18.734188 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-c4386d4b-3146-4525-94f6-4b91f06126c7 None None] MFA Rules not processed for user `fcd8bf55bab14d58b587d649af660a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:37:18.735406 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-c4386d4b-3146-4525-94f6-4b91f06126c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:37:18.744568 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 632/1228] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:37:18 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:37:20.118501 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=6 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:28.728585 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=21 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:31.282461 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d6d4e-c1c6-41a1-aa1a-d5f78fba65ab None None] REQUEST_METHOD: `POST` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:37:31.282974 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d6d4e-c1c6-41a1-aa1a-d5f78fba65ab None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:37:31.282974 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d6d4e-c1c6-41a1-aa1a-d5f78fba65ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:37:31.302115 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.auth.core [None req-c69d6d4e-c1c6-41a1-aa1a-d5f78fba65ab None None] MFA Rules not processed for user `92d413a4990944059167ff99ff9289ba`. Rule list: `[]` (Enabled: `True`). {{(pid=88384) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:37:31.303321 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-c69d6d4e-c1c6-41a1-aa1a-d5f78fba65ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:37:31.310525 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 597/1229] 10.222.0.43 () {58 vars in 958 bytes} [Sat Sep 3 21:37:31 2022] POST /identity/v3/auth/tokens => generated 2820 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:37:35.723915 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4386d4b-3146-4525-94f6-4b91f06126c7 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:37:35.735774 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4386d4b-3146-4525-94f6-4b91f06126c7 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:37:35.740235 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06b5b2-70dd-4a31-8cfb-66941952e144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:37:35.740948 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06b5b2-70dd-4a31-8cfb-66941952e144 service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:37:35.741224 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06b5b2-70dd-4a31-8cfb-66941952e144 service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:37:35.741493 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06b5b2-70dd-4a31-8cfb-66941952e144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:37:35.753364 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06b5b2-70dd-4a31-8cfb-66941952e144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:37:35.756184 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06b5b2-70dd-4a31-8cfb-66941952e144 service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:37:35.769832 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 633/1230] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:37:35 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:37:41.297204 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=3 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:45.764253 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=6 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:37:47.724760 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d6d4e-c1c6-41a1-aa1a-d5f78fba65ab None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:37:47.744907 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d6d4e-c1c6-41a1-aa1a-d5f78fba65ab None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:37:47.751296 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eadfab-871f-40ca-bb5e-77c7f14ad171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:37:47.752033 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eadfab-871f-40ca-bb5e-77c7f14ad171 service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:37:47.752452 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eadfab-871f-40ca-bb5e-77c7f14ad171 service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:37:47.752939 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eadfab-871f-40ca-bb5e-77c7f14ad171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:37:47.764193 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eadfab-871f-40ca-bb5e-77c7f14ad171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:37:47.766243 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eadfab-871f-40ca-bb5e-77c7f14ad171 service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:37:47.779422 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 598/1231] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:37:47 2022] GET /identity/v3/auth/tokens => generated 2820 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:37:57.315965 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06b5b2-70dd-4a31-8cfb-66941952e144 service neutron] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:37:57.380596 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06b5b2-70dd-4a31-8cfb-66941952e144 service neutron] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:37:57.384242 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f074b-4dbc-41cd-bf4a-aef4632c0f3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90cd1e165f3c4eba95dc93a25011b695', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:37:57.385137 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f074b-4dbc-41cd-bf4a-aef4632c0f3b service cinder] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:37:57.385413 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f074b-4dbc-41cd-bf4a-aef4632c0f3b service cinder] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:37:57.385702 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f074b-4dbc-41cd-bf4a-aef4632c0f3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:37:57.396054 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f074b-4dbc-41cd-bf4a-aef4632c0f3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:37:57.397526 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f074b-4dbc-41cd-bf4a-aef4632c0f3b service cinder] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:37:57.407652 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 634/1232] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:37:57 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:37:57.773441 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=6 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:02.810053 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eadfab-871f-40ca-bb5e-77c7f14ad171 service nova] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:38:02.820482 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eadfab-871f-40ca-bb5e-77c7f14ad171 service nova] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:38:02.824259 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988eff94-3e10-4ac2-a681-99febc40c84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:38:02.824924 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988eff94-3e10-4ac2-a681-99febc40c84c service neutron] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:38:02.825204 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988eff94-3e10-4ac2-a681-99febc40c84c service neutron] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:38:02.825470 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988eff94-3e10-4ac2-a681-99febc40c84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:38:02.836467 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988eff94-3e10-4ac2-a681-99febc40c84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:38:02.838025 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988eff94-3e10-4ac2-a681-99febc40c84c service neutron] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:38:02.849467 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 599/1233] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:38:02 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:38:07.403312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=30 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:12.844229 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=6 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:38:26.157724 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f074b-4dbc-41cd-bf4a-aef4632c0f3b service cinder] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:38:26.167538 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f074b-4dbc-41cd-bf4a-aef4632c0f3b service cinder] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:38:26.171230 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2809e3d-9b5c-4530-b65c-129da3967d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:38:26.172037 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2809e3d-9b5c-4530-b65c-129da3967d45 service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:38:26.172162 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2809e3d-9b5c-4530-b65c-129da3967d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:38:26.172354 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2809e3d-9b5c-4530-b65c-129da3967d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:38:26.180343 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2809e3d-9b5c-4530-b65c-129da3967d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:38:26.181823 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2809e3d-9b5c-4530-b65c-129da3967d45 service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:38:26.190821 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 635/1234] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:38:26 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:38:36.186602 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=6 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:12.299947 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988eff94-3e10-4ac2-a681-99febc40c84c service neutron] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:39:12.312889 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988eff94-3e10-4ac2-a681-99febc40c84c service neutron] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:39:12.319823 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded0d28-8382-432a-9c61-078e931e0961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:39:12.320482 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded0d28-8382-432a-9c61-078e931e0961 service nova] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:39:12.320759 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded0d28-8382-432a-9c61-078e931e0961 service nova] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:39:12.321607 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded0d28-8382-432a-9c61-078e931e0961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:39:12.331008 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded0d28-8382-432a-9c61-078e931e0961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:39:12.332652 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded0d28-8382-432a-9c61-078e931e0961 service nova] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:39:12.344649 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 600/1235] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:39:12 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:39:22.338814 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=6 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:27.177262 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2809e3d-9b5c-4530-b65c-129da3967d45 service neutron] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:39:27.184820 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2809e3d-9b5c-4530-b65c-129da3967d45 service neutron] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:39:27.188346 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a931d0-b5cb-4c5a-9e8a-43c1071256c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:39:27.189020 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a931d0-b5cb-4c5a-9e8a-43c1071256c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:39:27.189300 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a931d0-b5cb-4c5a-9e8a-43c1071256c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:39:27.189574 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a931d0-b5cb-4c5a-9e8a-43c1071256c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:39:27.261126 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a931d0-b5cb-4c5a-9e8a-43c1071256c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:39:27.262563 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a931d0-b5cb-4c5a-9e8a-43c1071256c2 service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:39:27.281412 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 636/1236] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:39:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:39:31.187416 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a87f-260c-450f-98f9-fa554a6f7117 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:39:31.187897 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a87f-260c-450f-98f9-fa554a6f7117 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:39:31.188032 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22a87f-260c-450f-98f9-fa554a6f7117 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:39:31.189322 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 601/1237] 10.222.0.43 () {54 vars in 921 bytes} [Sat Sep 3 21:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:39:31.200568 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963ab61-081d-4c93-89de-e970da335c26 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:39:31.201088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963ab61-081d-4c93-89de-e970da335c26 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:39:31.207882 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963ab61-081d-4c93-89de-e970da335c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:39:31.243157 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-d963ab61-081d-4c93-89de-e970da335c26 None None] MFA Rules not processed for user `5fb45f9358b64974a39d996e93e5c105`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:39:31.244295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-d963ab61-081d-4c93-89de-e970da335c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:39:31.252974 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 637/1238] 10.222.0.43 () {58 vars in 1018 bytes} [Sat Sep 3 21:39:31 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:39:31.266230 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fac83-165f-4c88-84ca-c9c6a5adb993 None None] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:39:31.266514 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fac83-165f-4c88-84ca-c9c6a5adb993 None None] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:39:31.267080 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fac83-165f-4c88-84ca-c9c6a5adb993 None None] PATH_INFO: `/` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:39:31.268717 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 602/1239] 10.222.0.43 () {54 vars in 961 bytes} [Sat Sep 3 21:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 03 21:39:31.275140 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1847d0-2d12-4e65-b150-08ec05187998 None None] REQUEST_METHOD: `POST` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:39:31.275530 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1847d0-2d12-4e65-b150-08ec05187998 None None] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:39:31.275836 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1847d0-2d12-4e65-b150-08ec05187998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:39:31.297840 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.auth.core [None req-dd1847d0-2d12-4e65-b150-08ec05187998 None None] MFA Rules not processed for user `5fb45f9358b64974a39d996e93e5c105`. Rule list: `[]` (Enabled: `True`). {{(pid=88385) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 03 21:39:31.299177 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-dd1847d0-2d12-4e65-b150-08ec05187998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:39:31.308913 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 638/1240] 10.222.0.43 () {58 vars in 1058 bytes} [Sat Sep 3 21:39:31 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 03 21:39:31.316916 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fac83-165f-4c88-84ca-c9c6a5adb993 None None] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:39:31.332882 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fac83-165f-4c88-84ca-c9c6a5adb993 None None] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:39:31.338194 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2d506-887a-47d2-9d11-6bb3ec143f89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb45f9358b64974a39d996e93e5c105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:39:31.338801 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d506-887a-47d2-9d11-6bb3ec143f89 service placement] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:39:31.339108 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d506-887a-47d2-9d11-6bb3ec143f89 service placement] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:39:31.339563 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2d506-887a-47d2-9d11-6bb3ec143f89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:39:31.348909 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2d506-887a-47d2-9d11-6bb3ec143f89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:39:31.350516 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2d506-887a-47d2-9d11-6bb3ec143f89 service placement] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:39:31.361096 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 603/1241] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:39:31 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:39:35.489295 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1847d0-2d12-4e65-b150-08ec05187998 None None] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:39:35.503752 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1847d0-2d12-4e65-b150-08ec05187998 None None] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:39:35.509351 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a716877-5ed6-4be2-bb06-8e22fcc48be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:39:35.510340 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a716877-5ed6-4be2-bb06-8e22fcc48be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:39:35.510692 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a716877-5ed6-4be2-bb06-8e22fcc48be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:39:35.511093 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a716877-5ed6-4be2-bb06-8e22fcc48be3 admin admin] PATH_INFO: `/v3/users/92d413a4990944059167ff99ff9289ba` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:39:35.512769 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a716877-5ed6-4be2-bb06-8e22fcc48be3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d413a4990944059167ff99ff9289ba)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:39:35.514740 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a716877-5ed6-4be2-bb06-8e22fcc48be3 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:39:35.787487 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-8a716877-5ed6-4be2-bb06-8e22fcc48be3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d413a4990944059167ff99ff9289ba'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:35.788149 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-8a716877-5ed6-4be2-bb06-8e22fcc48be3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d413a4990944059167ff99ff9289ba'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:35.800956 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-8a716877-5ed6-4be2-bb06-8e22fcc48be3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d413a4990944059167ff99ff9289ba'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:35.808298 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-8a716877-5ed6-4be2-bb06-8e22fcc48be3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d413a4990944059167ff99ff9289ba'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:35.810918 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-8a716877-5ed6-4be2-bb06-8e22fcc48be3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d413a4990944059167ff99ff9289ba'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:35.911003 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 639/1242] 10.222.0.43 () {58 vars in 1224 bytes} [Sat Sep 3 21:39:35 2022] DELETE /identity/v3/users/92d413a4990944059167ff99ff9289ba => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:39:36.241663 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2d506-887a-47d2-9d11-6bb3ec143f89 service placement] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:39:36.253968 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2d506-887a-47d2-9d11-6bb3ec143f89 service placement] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:39:36.318035 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:39:36.318580 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:39:36.318858 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:39:36.319152 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] PATH_INFO: `/v3/projects/7645ca279eba49e8a352ccb4b0002704` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:39:36.320354 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7645ca279eba49e8a352ccb4b0002704)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:39:36.322378 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:39:36.451373 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7645ca279eba49e8a352ccb4b0002704', 'request_id': 'req-ab0910d3-be0e-4f95-845e-c868c40389e4'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:36.460121 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7645ca279eba49e8a352ccb4b0002704', 'request_id': 'req-ab0910d3-be0e-4f95-845e-c868c40389e4'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:36.467520 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7645ca279eba49e8a352ccb4b0002704', 'request_id': 'req-ab0910d3-be0e-4f95-845e-c868c40389e4'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:36.605866 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] The token cache is being invalidate because project 7645ca279eba49e8a352ccb4b0002704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 21:39:36.606138 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:36.606804 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:36.608331 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 604/1243] 10.222.0.43 () {58 vars in 1233 bytes} [Sat Sep 3 21:39:36 2022] DELETE /identity/v3/projects/7645ca279eba49e8a352ccb4b0002704 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:39:36.612400 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a716877-5ed6-4be2-bb06-8e22fcc48be3 admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:39:36.613978 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-8a716877-5ed6-4be2-bb06-8e22fcc48be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:39:36.627639 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a716877-5ed6-4be2-bb06-8e22fcc48be3 admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:39:36.647591 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:36.694675 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1be83b-dedb-40e6-91b2-3ba573abbe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:39:36.695335 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1be83b-dedb-40e6-91b2-3ba573abbe30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:39:36.695618 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1be83b-dedb-40e6-91b2-3ba573abbe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:39:36.695921 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1be83b-dedb-40e6-91b2-3ba573abbe30 admin admin] PATH_INFO: `/v3/users/b9dd9fcc4bb84a4693de2d2a1e304af7` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:39:36.697129 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1be83b-dedb-40e6-91b2-3ba573abbe30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9dd9fcc4bb84a4693de2d2a1e304af7)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:39:36.699156 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1be83b-dedb-40e6-91b2-3ba573abbe30 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:39:36.921009 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-fc1be83b-dedb-40e6-91b2-3ba573abbe30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9dd9fcc4bb84a4693de2d2a1e304af7'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:36.921670 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-fc1be83b-dedb-40e6-91b2-3ba573abbe30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9dd9fcc4bb84a4693de2d2a1e304af7'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:36.934612 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-fc1be83b-dedb-40e6-91b2-3ba573abbe30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9dd9fcc4bb84a4693de2d2a1e304af7'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:36.942313 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-fc1be83b-dedb-40e6-91b2-3ba573abbe30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9dd9fcc4bb84a4693de2d2a1e304af7'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:36.943026 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-fc1be83b-dedb-40e6-91b2-3ba573abbe30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9dd9fcc4bb84a4693de2d2a1e304af7'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:36.998085 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 640/1244] 10.222.0.43 () {58 vars in 1224 bytes} [Sat Sep 3 21:39:36 2022] DELETE /identity/v3/users/b9dd9fcc4bb84a4693de2d2a1e304af7 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:39:37.303122 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:39:37.304587 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:39:37.318084 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0910d3-be0e-4f95-845e-c868c40389e4 admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:39:37.375960 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:39:37.376629 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:39:37.376927 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:39:37.377257 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] PATH_INFO: `/v3/projects/de6d0a2afc48417f9183673683bccc40` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:39:37.379016 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de6d0a2afc48417f9183673683bccc40)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:39:37.380963 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:39:37.389413 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:37.523121 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de6d0a2afc48417f9183673683bccc40', 'request_id': 'req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:37.530631 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de6d0a2afc48417f9183673683bccc40', 'request_id': 'req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:37.536576 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de6d0a2afc48417f9183673683bccc40', 'request_id': 'req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:37.651203 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] The token cache is being invalidate because project de6d0a2afc48417f9183673683bccc40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88384) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 21:39:37.651486 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:37.652151 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:39:37.653686 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 605/1245] 10.222.0.43 () {58 vars in 1233 bytes} [Sat Sep 3 21:39:37 2022] DELETE /identity/v3/projects/de6d0a2afc48417f9183673683bccc40 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:39:47.059078 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:39:47.646458 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:40:59.569984 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1be83b-dedb-40e6-91b2-3ba573abbe30 admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:40:59.571464 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-fc1be83b-dedb-40e6-91b2-3ba573abbe30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:40:59.645043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1be83b-dedb-40e6-91b2-3ba573abbe30 admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:40:59.704035 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfb6ab-aee4-495d-9d3c-4ebbe3abd700 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d95ba5e28764ed49d1142fecb16adab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:40:59.704678 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfb6ab-aee4-495d-9d3c-4ebbe3abd700 service nova] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:40:59.704961 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfb6ab-aee4-495d-9d3c-4ebbe3abd700 service nova] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:40:59.705234 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bfb6ab-aee4-495d-9d3c-4ebbe3abd700 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:40:59.706936 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-19bfb6ab-aee4-495d-9d3c-4ebbe3abd700 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:40:59.765582 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfb6ab-aee4-495d-9d3c-4ebbe3abd700 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:40:59.767188 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bfb6ab-aee4-495d-9d3c-4ebbe3abd700 service nova] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:40:59.776319 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 641/1246] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:40:59 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 03 21:41:02.639998 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:41:02.641424 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:41:02.724305 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1b5f2-a1fa-4d17-a5f0-af6ca5bf5915 admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:41:02.729376 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9812-680e-48ba-b412-def2b7103542 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5fb45f9358b64974a39d996e93e5c105', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:41:02.729981 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9812-680e-48ba-b412-def2b7103542 service placement] REQUEST_METHOD: `GET` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:41:02.730268 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9812-680e-48ba-b412-def2b7103542 service placement] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:41:02.730529 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9812-680e-48ba-b412-def2b7103542 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:41:02.732270 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-c5ab9812-680e-48ba-b412-def2b7103542 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:41:02.743966 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab9812-680e-48ba-b412-def2b7103542 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:41:02.745512 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab9812-680e-48ba-b412-def2b7103542 service placement] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:41:02.755938 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 606/1247] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:41:02 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:41:09.772208 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=80 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:12.751129 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=37 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:12.793891 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfb6ab-aee4-495d-9d3c-4ebbe3abd700 service nova] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:41:12.795320 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-19bfb6ab-aee4-495d-9d3c-4ebbe3abd700 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:41:12.851685 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bfb6ab-aee4-495d-9d3c-4ebbe3abd700 service nova] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:41:12.855239 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff90434-698a-4311-9afb-38e6f9a5e8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a969a77183c34a7e9eff28636b1170c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bae29e3189d480c9200f03128f0c607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:41:12.855833 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff90434-698a-4311-9afb-38e6f9a5e8ab service neutron] REQUEST_METHOD: `GET` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:41:12.856109 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff90434-698a-4311-9afb-38e6f9a5e8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:41:12.856381 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff90434-698a-4311-9afb-38e6f9a5e8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:41:12.858145 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-0ff90434-698a-4311-9afb-38e6f9a5e8ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:41:12.921309 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff90434-698a-4311-9afb-38e6f9a5e8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:41:12.922960 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff90434-698a-4311-9afb-38e6f9a5e8ab service neutron] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:41:12.933201 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 642/1248] 10.222.0.43 () {60 vars in 1365 bytes} [Sat Sep 3 21:41:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 03 21:41:20.136196 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9812-680e-48ba-b412-def2b7103542 service placement] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:41:20.139473 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-c5ab9812-680e-48ba-b412-def2b7103542 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:41:20.152204 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9812-680e-48ba-b412-def2b7103542 service placement] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:41:20.156814 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:41:20.157380 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:41:20.157656 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:41:20.157927 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] PATH_INFO: `/v3/users/fcd8bf55bab14d58b587d649af660a1b` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:41:20.159026 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd8bf55bab14d58b587d649af660a1b)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:41:20.160036 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: WARNING py.warnings [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:41:20.160036 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: warnings.warn(msg) Sep 03 21:41:20.160036 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: Sep 03 21:41:20.161325 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:41:20.378050 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd8bf55bab14d58b587d649af660a1b'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:20.378927 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd8bf55bab14d58b587d649af660a1b'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:20.379626 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd8bf55bab14d58b587d649af660a1b'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:20.398574 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd8bf55bab14d58b587d649af660a1b'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:20.408719 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd8bf55bab14d58b587d649af660a1b'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:20.469551 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 607/1249] 10.222.0.43 () {58 vars in 1224 bytes} [Sat Sep 3 21:41:20 2022] DELETE /identity/v3/users/fcd8bf55bab14d58b587d649af660a1b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:41:20.722549 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff90434-698a-4311-9afb-38e6f9a5e8ab service neutron] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:41:20.734169 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff90434-698a-4311-9afb-38e6f9a5e8ab service neutron] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:41:20.797043 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:41:20.797661 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:41:20.797939 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:41:20.798208 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] PATH_INFO: `/v3/projects/9eaad2e8728440dfab9eddb6ffcaab88` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:41:20.799308 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eaad2e8728440dfab9eddb6ffcaab88)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:41:20.800312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: WARNING py.warnings [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 03 21:41:20.800312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: warnings.warn(msg) Sep 03 21:41:20.800312 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: Sep 03 21:41:20.801572 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:41:20.951482 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eaad2e8728440dfab9eddb6ffcaab88', 'request_id': 'req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:20.959665 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:20.964986 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eaad2e8728440dfab9eddb6ffcaab88', 'request_id': 'req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:20.974470 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eaad2e8728440dfab9eddb6ffcaab88', 'request_id': 'req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:21.079577 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] The token cache is being invalidate because project 9eaad2e8728440dfab9eddb6ffcaab88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 21:41:21.080419 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:21.080561 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:21.082072 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 643/1250] 10.222.0.43 () {58 vars in 1233 bytes} [Sat Sep 3 21:41:20 2022] DELETE /identity/v3/projects/9eaad2e8728440dfab9eddb6ffcaab88 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:41:21.086884 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] Authenticating user token {{(pid=88384) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:41:21.088560 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.fernet_utils [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88384) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:41:21.102818 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e1e63-cb47-4139-9d8f-e491c08a2a23 admin admin] Validating token access rules against request {{(pid=88384) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:41:21.158515 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5daf4-40f6-46bb-8009-017a7bd31d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88384) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:41:21.159250 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5daf4-40f6-46bb-8009-017a7bd31d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:41:21.159429 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5daf4-40f6-46bb-8009-017a7bd31d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:41:21.159715 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5daf4-40f6-46bb-8009-017a7bd31d4c admin admin] PATH_INFO: `/v3/users/ed278e32234947068a4477e4c4cabec7` {{(pid=88384) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:41:21.160882 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5daf4-40f6-46bb-8009-017a7bd31d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed278e32234947068a4477e4c4cabec7)` {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:41:21.162823 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5daf4-40f6-46bb-8009-017a7bd31d4c admin admin] RBAC: Authorization granted {{(pid=88384) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:41:21.337040 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-18d5daf4-40f6-46bb-8009-017a7bd31d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed278e32234947068a4477e4c4cabec7'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:21.337688 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-18d5daf4-40f6-46bb-8009-017a7bd31d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed278e32234947068a4477e4c4cabec7'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:21.350375 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-18d5daf4-40f6-46bb-8009-017a7bd31d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed278e32234947068a4477e4c4cabec7'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:21.350499 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-18d5daf4-40f6-46bb-8009-017a7bd31d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed278e32234947068a4477e4c4cabec7'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:21.358449 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG keystone.notifications [None req-18d5daf4-40f6-46bb-8009-017a7bd31d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed278e32234947068a4477e4c4cabec7'} {{(pid=88384) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:21.360400 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:21.434991 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: [pid: 88384|app: 0|req: 608/1251] 10.222.0.43 () {58 vars in 1224 bytes} [Sat Sep 3 21:41:21 2022] DELETE /identity/v3/users/ed278e32234947068a4477e4c4cabec7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:41:21.661045 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] Authenticating user token {{(pid=88385) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 03 21:41:21.663725 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.fernet_utils [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88385) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 03 21:41:21.679219 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a81ea8-2a58-4a28-95a3-07b0e79a6a55 admin admin] Validating token access rules against request {{(pid=88385) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 03 21:41:21.744004 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a37c9-3ba7-4750-b07c-cb7d316a93a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e2bd2fbe30f4ddbb48bb8150f222665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2e3df601a7e4116a238ebd2db036ed5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88385) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 03 21:41:21.744703 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a37c9-3ba7-4750-b07c-cb7d316a93a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 03 21:41:21.744958 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a37c9-3ba7-4750-b07c-cb7d316a93a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 03 21:41:21.745253 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a37c9-3ba7-4750-b07c-cb7d316a93a3 admin admin] PATH_INFO: `/v3/projects/55be2ed8a4e6475f830eb0aaf2b9e35c` {{(pid=88385) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 03 21:41:21.746358 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a37c9-3ba7-4750-b07c-cb7d316a93a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55be2ed8a4e6475f830eb0aaf2b9e35c)` {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 03 21:41:21.748289 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a37c9-3ba7-4750-b07c-cb7d316a93a3 admin admin] RBAC: Authorization granted {{(pid=88385) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 03 21:41:21.830572 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-223a37c9-3ba7-4750-b07c-cb7d316a93a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55be2ed8a4e6475f830eb0aaf2b9e35c', 'request_id': 'req-223a37c9-3ba7-4750-b07c-cb7d316a93a3'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:21.836865 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-223a37c9-3ba7-4750-b07c-cb7d316a93a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55be2ed8a4e6475f830eb0aaf2b9e35c', 'request_id': 'req-223a37c9-3ba7-4750-b07c-cb7d316a93a3'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:21.842380 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-223a37c9-3ba7-4750-b07c-cb7d316a93a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55be2ed8a4e6475f830eb0aaf2b9e35c', 'request_id': 'req-223a37c9-3ba7-4750-b07c-cb7d316a93a3'} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:21.897493 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-223a37c9-3ba7-4750-b07c-cb7d316a93a3 admin admin] The token cache is being invalidate because project 55be2ed8a4e6475f830eb0aaf2b9e35c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88385) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 03 21:41:21.898391 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-223a37c9-3ba7-4750-b07c-cb7d316a93a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:21.899088 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG keystone.notifications [None req-223a37c9-3ba7-4750-b07c-cb7d316a93a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88385) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 03 21:41:21.900645 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: [pid: 88385|app: 0|req: 644/1252] 10.222.0.43 () {58 vars in 1233 bytes} [Sat Sep 3 21:41:21 2022] DELETE /identity/v3/projects/55be2ed8a4e6475f830eb0aaf2b9e35c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 03 21:41:31.515433 dv-osbrick-855740-1-ceph devstack@keystone.service[88384]: DEBUG dbcounter [-] [88384] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=88384) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 21:41:31.894337 dv-osbrick-855740-1-ceph devstack@keystone.service[88385]: DEBUG dbcounter [-] [88385] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88385) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}